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Abstract 


J 

Several  proposed  routing  algorithms  for  store  and  forward  communication 
networks,  including  one  currently  in  operation  in  the  ARPANET,  route 
messages  along  shortest  paths  computed  by  using  some  set  of  link  lengths. 

When  these  lengths  depend  on  current  traffic  conditions  as  they  must  in  an 
adaptive  algorithm,  dynamic  behavior  questions  such  as  stability,  convergence, 
and  speed  of  convergence  are  of  interest.  This  paper  is  the  first  attempt 
to  analyze  systematically  these  issues.  It  is  shown  that  minimum  queuing 
delay  path  algorithms  tend  to  exhibit  violent  oscillatory  behavior  in  the 
absence  of  a  damping  mechanism.  The  oscillations  can  be  damped  by  means 
of  several  types  of  schemes  two  of  which  are  analyzed  in  this  paper.  In 
the  first  scheme  a  constant  bias  is  added  to  the  queuing  delay  thereby 
providing  a  preference  towards  paths  with  small  number  of  links.  In  the 
second  scheme  the  effects  of  several  past  routings  are  averaged  as  for 
example  when  the  link  lengths  are  computed  and  comnunicated  asynchronously 
throughout  the  network. 


2 


1 .  Introduction 

A  central  operational  problem  of  a  communication  network  involves  the 
choice  of  routes  used  by  messages  to  travel  from  or: gin  to  destination.  It 
is  possible,  of  course,  to  choose  a  fixed  route  for  each  origin-destination 
pair,  but  this  precludes  the  possibility  of  adjusting  routes  to  alleviate 
congestion  due  to  variations  in  average  traffic  conditions.  For  this 

reason  attention  has  focused  on  adaptive  routing  strategies 
whereby  congestion  in  the  network  is  continuously  monitored  and  routes  between 
origin-destination  pairs  are  modified  in  real  time  so  as  to  keep  average 
delay  per  message  at  a  reasonable  level.  A  routing  scheme  of  this  type  was 
implemented  in  the  ARPANET  in  1969  and  attracted  considerable  attention. 

The  main  idea  in  this  scheme  is  to  compute  in  real  time  an  estimate  of  the 
minimum  average  delay  per  message  for  each  origin-destination  pair  and  to 
route  messages  along  the  current  minimum  estimated  delay  path.  When  this 
scheme  was  first  implemented,  it  was  noticed  that  it  is 

prone  to  severe  oscillations.  This  behaviour  is  due  to  the  fact  that 
delay  estimates  used  to  choose  routes  are  themselves  affected  by  the  route 
choice  with  a  feedback  effect  resulting.  To  remedy  this  situation  it  was 
decided  on  heuristic  grounds  to  introduce  an  additive  factor,  called  bias, 
to  the  estimated  delay  of  each  link,  thereby  building  into  the  algorithm 
a  preference  towards  paths  with  small  number  of  hops  to  the  destination 
[5]  -  [7].  This  had  a  stabilizing  effect  albeit  at  the  expense  of  considerable 
loss  of  sensitivity  to  traffic  congestion. 

The  implementation  of  the  minimum  delay  path  idea  in  the  original 
ARPANET  algorithm  had  a  number  of  flaws  allowing,  for  example,  the  formation 
of  loops.  For  thi:;  reason  alternative  schemes  based  on  the  same  idea  were 


m 
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studied,  and  a  new  algorithm  called  SPF  has  been  developed  and  imple¬ 
mented  [1] ,  [4] ,  [11]  .  The  present  paper  is  an  outgrowth  of  the 
author's  participation  in  the  design  study  of  this  algorithm  during  the  summer 
of  1978  at  BBN,  Inc.  However,  our  analysis  does  not  focus  on  the  ARPANET 
and  the  SPF  algorithm  in  particular,  but  rather  is  geared  towards  understanding 
the  effect  of  feedback  and  the  nature  of  the  dynamic  behaviour  of  shortest 
path  algorithms  where  link  lengths  depend  on  current  traffic  conditions. 

We  note  that  the  algorithms  of  this  paper  are  far  from  optimal  since  they 
are  single  path  algorithms  in  the  sense  that  at  any  given  time  there  is  only 
one  path  per  origin-destination  pair  along  which  messages  can  travel.  Better 
performance  can  be  achieved  by  allowing  multiple  paths  as  for  example  in  the 
optimization  algorithm  of  Gallager  f9)  or  its  second  derivative  versions  [2]  . 

On  the  other  hand  the  hardware  limitations  of  some  of  the  presently  existing 
networks  including  the  ARPANET  preclude  the  use  of  such  more  sophisticated 
algorithms.  Furthermore,  we  feel  that  the  mere  fact  that  the  algorithm  has 
been  successfully  implemented  in  a  network  as  interesting  and  influential 
as  the  ARPANET  makes  it  worthy  of  analysis  and  investigation.  This  is 
reinforced  by  the  fact  that  the  behavior  exhibited  by  the  algorithm  is 
quite  interesting  and  can  ;  ^se  nontrivial  design  problems. 

The  paper  is  organized  as  follows: 

In  Section  2  we  provide  a  deterministic  finite  state  Markov  chain 
framework  for  studying  a  simple  version  of  the  algorithm.  We  show  that  for 
ring  networks  the  algorithm  may  tend  to  oscillate  between  poor  routing  paths 
and  become  itself  a  major  contributor  to  congestion.  We  also  demonstrate 
how  the  use  of  a  bias  factor  can  provide  a  mechanism  for  damping  oscillations 
as  confirmed  by  experience  with  the  original  ARPANET  algorithm. 
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The  finite  state  model  does  not  lend  itself  to  analysis  of  more  sophisticated 
routing  schemes  and  more  general  network  topologies.  We  consequently  introduce 
in  Section  3  a  model  of  a  ring  network  with  a  continuum  of  nodes  and  a  single 
destination.  This  allows  us  to  employ  techniques  of  stability  analysis  of 
discrete-time  systems  with  continuous  state  space,  and  enables  us  to  further 
quantify  the  relationship  between  choice  of  link  lengths  and  algorithmic 
behavior . 

The  analysis  of  Section  3  focuses  primarily  on  the  effect  of  using  a 
bias  factor  as  a  deunping  mechanism.  In  Section  4  we  show  that  oscillations 
can  also  be  damped  effectively  by  making  the  link  lengths  dependent  on 
several  preceding  routing  paths  via  some  averaging  mechanism  such  as  a  fading 
memory  scheme  or  asynchronous  link  length  updating.  To  our  knowledge  the 
fact  that  averaging  can  provide  a  damping  mechanism  in  a  shortest  path  algorithm 
has  not  been  noticed  earlier  and  in  fact  when  we  originally  approached  this 
problem  at  BBN,  Inc.  there  was  considerable  concern  regarding  its  effect  on 
algorithmic  behavior.  It  is  now  believed  that  the  significant  degree  of 
averaging  inherently  present  in  the  SPF  algorithm  is  in  large  measure  responsible 
for  the  stable  dynamic  behavior  observed  in  experiments  conducted  thus  far 
[11]. 

The  analysis  of  Sections  2-4  focuses  on  ring  networks.  The  ring 
topology  is  central  for  the  extension  of  our  earlier  results  to  more  complex 
network  topologies.  This  extension  is  carried  out  in  Section  5  under  the 
assumption  that  an  equilibrium  routing  exists.  However,  by  contrast  with 
ring  networks,  an  equilibrium  routing  need  not  always  exist  for  more  complex 
topologies.  We  demonstrate  via  example  the  mechanism  by  which  such  a 
phenomenon  can  occur. 

The  results  and  analysis  of  the  present  paper  can  be  generalized  to 
the  case  where  there  are  more  than  one  destinations.  This  analysis  is 


straightforward  but  considerably  more  complex  technically  and  may  be  found  in  [3] . 
The  continuous  node  model  of  Sections  3-5  may  be  criticized  on  the  grounds 
that  it  is  unrealistic.  On  the  other  hand  it  is  very  difficult  to  provide  an 
extensive  analysis  of  a  more  realistic  finite  node  network  model.  In  particular, 
it  appears  impossible  to  demonstrate  the  effect  of  averaging  in  such  a  context. 
Furthermore  we  believe  that  the  realism  of  any  algorithmic  model  must  be  judged 
on  the  basis  of  the  validity  of  the  conclusions  it  provides  regarding  the 
behavior  of  the  related  practical  algorithm.  These  conclusions  in  our  case 
have  been  verified  by  extensive  numerical  experiments  with  finite  node  net¬ 
works  [4] ,  [3] .  In  particular  the  validity  of  our  qualitative  results 

regarding  the  role  of  a  bias  factor  and  averaging  as  damping  mechanisms 
have  been  amply  demonstrated. 

2 .  A  Finite  State  Markov  Chain  Model 

Consider  a  communication  network  with  nodes  denoted  by  1,2,...,N  and 
directed  links  denoted  by  {i,Z)  where  i  is  the  head  node  and  Z  is  the  tail 
node.  We  consider  the  following  algorithm  for  periodically  updating  paths 
for  routing  messages. 

(A)  At  the  beginning  of  every  time  period  a  nonegative  length  of 

every  link  (i,£)  becomes  availabe  to  each  node.  Based  on  these  lengths  each 
node  computes  a  shortest  path  to  each  destination  and  routes  messages  over 
that  path  during  the  period. 

The  standing  assumption  for  algorithm  (A)  is  that  the  lengths  used 
in  computation  of  a  new  shortest  path  depend  exclusively  on  one  or  more 
preceding  shortest  paths.  This  dependence  is  deterministic  via  a  rule  that 
for  the  moment  we  leave  unspecified.  As  an  example  may  represent  some 
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measure  of  average  delay  per  message  on  link  (i,£)  during  one  or  more  preceding 
periods  perhaps  with  an  added  bias  factor  -a  scheme  currently  implemented  in 
the  ARPANET  [1] ,  [11] .  By  assuming  that  the  dependence  of  on  previous 
shortest  paths  is  deterministic  we  also  implicitly  assume  that  the  input  traffic 
originating  at  each  node  is  a  stationary  stochastic  process  whose  ensemble  para¬ 
meters  can  be  adequately  measured  by  time  averages.  This  assumption  is  not 
valid,  of  course,  in  practice  but  is  a  reasonable  approximation  to  the  situation 
where  the  time  constant  of  traffic  statistic  variations  is  large  relative  to 
the  shortest  path  updating  period  (a  quasistatic  assumption,  cf.  [9]). 

Consider  first  algorithm  (A)  applied  to  a  given  network  for  the  case  where 
the  lengths  depend  exclusively  on  the  preceding  shortest  path.  Assume 
also  that  the  shortest  path  algorithm  has  a  fixed  rule  for  breaking  ties 
between  equidistant  paths.  Then  each  shortest  path  uniquely  determines  the 
next  shortest  path.  There  is  a  finite  number  of  possible  shortest  paths 
(also  referred  to  as  routings)  which  we  denote  by  ,  R2,....,RM  where  M 

is  some  integer.  To  any  initial  routing  say  R.  ,  there  corresponds  a 

o 

unique  sequence  of  subsequent  routings  R.  ,  R.  ,...  Thus  eventually  some 

X1  12 

routing  will  be  repeated  (say  R.  =  R.  ) ,  and  once  this  happens  the  routing 

1k  Lk+n 

sequence  will  become  periodic.  Thus  starting  at  R.  the  algorithm  will 

o 

eventually  end  up  cycling  through  R.  ,...R.  .  of  course  it  is  possible 

\  xk+n-l 

that  R^  itself  is  part  of  the  cycle  (k=0) ,  and  that  the  cycle  consists  of 


o 

a  single  routing  (n=l)  in  which  case  the  algorithm  stabilizes  at  that 
routing. 

The  model  just  described  is  one  of  a  deterministric  finite  state  Markov 

chain  with  states  R^,...R^.  From  Markov  chain  theory  or  by  elementary 

reasoning  it  follows  that  the  set  of  all  routings  {R,,...,R>  can  be  parti- 

1  M 
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tioned  into  a  collection  of  cycles  (or  ergodic  classes) ,  and  a  collection  of 
transient  routings.  If  the  initial  routing  is  transient  it  is  never  repeated 
by  the  algorithm,  and  if  it  is  part  of  a  cycle  the  algorithm  returns  to  it 
periodically.  More  than  one  cycles  may  exist.  Furthermore,  each  transient 
routing  leads  to  a  unique  cycle. 

When  the  lengths  depend  on  a  fixed  number  (say  m)  of  preceding  routings, 
a  finite  state  model  for  the  algorithm  can  be  similarly  constructed  whereby 
the  state  space  of  the  model  is  the  set  of  all  m-tuples  of  routings.  Similarly 
the  state  space  can  be  partitioned  into  cycles  and  transient  states.  Analysis 
of  such  a  model  is  naturally  more  difficult  in  view  of  the  increased  size 
of  the  state  space,  and  this  is  more  so  if  depends  on  all  preceding 
routings  in  which  case  a  countable  state  Markov  chain  model  is  necessary. 


In  what  follows  in  this  section  we  will  restrict  attention  to  the  case 


of  a  ring  network  with  N  nodes  shown  in  Figure  1.  Node  N  is  the  only 
destination  and  all  links  are  bidirectional.  By  reversing  the  directions 
of  flow  and  the  role  of  origins  and  destinations  the  subsequent  model  can 
be  converted  to  one  with  a  single  origin  and  many  destinations.  The 
traffic  input  originating 


i-1  ri  ri*l 
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at  node  i  and  destined  for  N  is  denoted  by  r^.  The  routing  R^  ,  i  * 
is  the  one  for  which  all  nodes  j  <  i  route  their  traffic  in  the  clockwise 
direction  and  all  nodes  j  i  route  their  traffic  in  the  counterclockwise 
direction 


Figure  2 


as  shown  in  Figure  2.  Given  a  routing  R^,  the  flows  on  each  undirected 
link  ( j— 1 , j )  in  the  clockwise  and  counterclockwise  direction  are  denoted 


by  fj(i)  and  f ^  (i)  respectively  and  are  given  by 


f]CD  - 


fj<i>  - 


0 

if 

i  *  j 

ri-l  +  ri-2  +  +rj 

if 

j  <  i 

^i  +  ^i  +  l  +  •',  4  rJ-l 

if 

i.  <  j 

0 

if 

J  *  i 

We  will  consider  the  case  where  the  length  of  a  link  (i,£)  is  given 
by  an  equation  of  the  form 

(1)  D.£  =d(f.£) 

where  f  ^  is  the  flow  on  link{i,£)  during  the  preceding  period  and 
d  is  a  real  valued,  continuously  differentiable  and  monotonically 
increasing  function  of  flow  with  d(0)  ^  0.  For  simplicity  we  assume  that 
the  function  d  is  the  same  for  all  links  but  this  does  not  affect  materially 
the  analysis  that  follows.  Since  the  flow  f  ^  depends  only  on  the  preceding 
routing  the  same  is  true  for  the  length  .  It  appears  that  this  simplest 

of  all  possible  situations  is  the  only  one  that  can  be  analyzed  effectively 
in  a  finite  node  network  context.  The  practical  situation  where  is 
taken  to  be  the  average  time  delay  for  a  message  to  traverse  link  (i,£.)  can 
be  reasonably  modelled  by  a  function  d  of  the  form 

(2)  d(f.£)  =  Pi£  +  Ti£  +  2u(fU> 
where 

=  Average  processing  plus  propagation  delay  per  message 
T^  =  Average  transmission  delay  per  message 
Qi £ (f i^)  =  Average  queuing  delay  per  message  when  the  average 
flow  on  link  (i,fc)  is  f^  . 

The  quantities  P.  0  and  T.0  are  independent  of  the  flow  f.„  while  the 

1.  Ar  i  X/  1 

dependence  of  Q  ^  on  f^  is  determined  by  the  statistics  of  the  traffic 
arriving  at  i  and  routed  through  i.  If  these  statistics  can  be  adequately 
modelled  by  an  M/M/1  queue  then  ^  takes  the  form  [6] ,  17] 
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where  is  the  transmission  capacity  of  link  (i,£).  We  mention,  however, 
that  on  the  basis  of  experiments  conducted  thus  far  it  is  unclear  whether 
the  average  delay  per  message  in  the  ARPANET  can  indeed  by  modelled  as  in 
(2) .  This  may  be  due  to  peculiarities  of  the  ARPANET  hardware  which  are 
little  understood  at  present.  We  now  define  the  shortest  path  algorithm 
Given  a  routing  R^  we  define  the  distances  D  (i,j),  D+(i,j)  of  node  j  to 
the  destination  in  the  counterclockwise  and  clockwise  directions  respectively 
by 

j 

D  (i, j )  =  £  d[f  (i) ] 

&=1  * 


D+(i,j)  =  £  dtft (i) ] - 

£=j+l  * 

If  D  (i,i)  =  D+(i,i)  then  the  algorithm  sets  the  next  routing  to  R^> 

D  (i,i)  ^  D+(i,i)  the  algorithm  sets  the  next  routing  to  R^  where  the  node  n 
is  such  that 


D  (i,  j)  _>  D+(i,j)  for  j  >_  n 

D  (i,j)  <  D+ { i , j )  for  j  <  n  . 

It  can  be  easily  shown  that  if  D  (i,i)  /  D+(i,i)  the  next  routing  R^  is 

uniquely  determined  by  the  relations  above.  Given  an  initial  routing  R® 

.  12  k  k+1 

we  consider  the  sequence  of  successive  routings  R,R,...R,R  , ..., 

generated  by  the  algorithm. 

The  quantity  d(0)  may  be  viewed  as  a  bias  factor.  It  represents  link 
length  at  zero  flow.  The  following  proposition  shows  that  if  d(0)  =  0  and 
the  first  two  routings  are  different,  i.e.  R°  f  R1  then  the  algorithm  ends 
up  oscillating  between  the  two  extreme  routings  R^  and  R^  which  is  the  worst 
possible  behavior  that  can  occur.  In  the  context  of  (2)  the  case  d(0)  =  0 


corresponds  to  the  situation  where  the  processing  and  transmission  delays 
Pi£  an<^  Ti£  are  negligible  relative  to  the  queuing  delay 


11 


Proposition  1;  Let  d(0)  =0  and  assume  that  R^jtR^.  Then  there  exists  an 

—  —  k  k+1  k 

index  k  such  that  for  all  k^k  either  R  =  R^  and  R  =1^  or  R  and 

k+1 

R  =  R^. 

Proof:  Let  be  a  routing  and  assume  that  the  routing  subsequent  to  R^  is 

R  with  n  jti.  For  concreteness  assume  that  n  <  i.  We  will  show  that  either 
n 

i  =  N  or  else  the  routing  subsequent  to  R^  is  R^  with  j>i. 

If  i^H  then  since  R^  is  the  routing  subsequent  to  R^  we  have 


(4) 


D  (i,n-l)  <  D+(i,n-l)  =  D+(i,i). 


We  also  have 

(5)  D+(i,i)  *  D+(n,i), 

(6)  D'(n,i)  *  D'(i,n-1). 

From  (4)  -  (6)  we  have 

D+(n,i)  *  D+(i,i)  >  D_ (i,n-l)  a  D_(n,i) 

so  finally 

D+(n,i)  >  D  (n, i) . 

It  follows  that  in  the  routing  R^  which  is  subsequent  to  R^,  node  i  will 

switch  his  traffic  to  the  clockwise  direction  so  that  j  >  i. 

We  can  show  using  a  very  similar  argument  that  if  n  >  i  then 
either  i *  1  or  else  the  routing  subsequent  to  Rr  is  R^  with  j  <  i. 

Thus  we  have  that  the  number  of  nodes  that  lie  between  two 
successive  routings  is  increasing  at  each  iteration  if  none  of  these 
routings  is  R^  or  R^.  On  the  other  hand  if  the  current  routing  is  R^  or 
R^  then  the  next  routing  will  clearly  be  R^  or  R^  respectively.  This  proves 


12 


the  proposition.  Q.E.D. 

Notice  that,  if  d(0)  *0,  the  situation  R° * R1  can  only  occur  if 
D^i,!)  =D+(i,i)  where  i  is  the  node  for  which  R0-R1<  Thus  if  we  add  any 
£>  0  to  any  one  of  the  node  inputs  we  will  have  R  ^ R  and  the  algorithm 

will  again  end  up  oscillating  between  Rj  and  R^  We  provide  an  example 
illustrating  the  result  of  Proposition  1.  Several  additional  examples 

involving  more  general  topologies  and  multiple  destinations  may  be  found 
in  [4]. 

Example ;  Consider  a  16-node  ring  network  where  node  16  is  the  destination. 
Letr  =  1  for  i  =  1,... ,7,9,. ..,15  and  r  =  £  >  0.  If  e  =  0  and  the  initial 

1  O  — 

routing  is  R  then  by  symmetry  all  subsequent  routings  equal  R_.  If  £ 

O  O 

is  very  small  but  positive  then  for  the  case  where 
d(f)  =  f 

the  sequence  of  generated  routings  is  R„,  R, ,  R, ,  R, c ,  R.  ,  R._,  R, , . . . 

o  XU  J  lb  X  lb  X 

This  fact  can  be  verified  via  a  straightforward  calculation  in  Figure  3 
which  shows  the  flow  patterns  corresponding  to  successive  routings. 

We  now  turn  our  attention  to  various  notions  of  equilibria  and 
stability.  We  say  that  R^  is  an  equilibrium  routing  if 

D  (i,i-l)  <  D+(i,i-l),  and  D+(i,i)  <  D  (i,i). 

It  follows  from  this  definition  that  R^  is  an  equilibrium  routing  if  and 
only  if  it  repeats  itself  via  the  shortest  path  algorithm. 

We  say  that  a  node  i  is  an  equilibrium  node  if 

D  (i , i )  <  D+(i,i),  and  D+(i+l,i)  £D  (i+l,i) 

In  words  a  node  i  is  an  equilibrium  node  if  he  switches  his  traffic  in 

both  cases  where  the  routing  is  R.  and  R.  , . 

l  l+l 
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We  say  that  an  equilibrium  routing  R^  is  locally  stable  if  routing 
Ri+1  generates  either  or  R^_^  through  the  algorithm,  and  routing  R^ 
generates  either  R^  or  We  say  that  an  equilibrium  node  i  is  locally 

stable  if  routing  R^  generates  Ri+1  via  the  algorithm,  and  routing  R^ 
generates  R^.  The  definition  of  local  stability  is  based  on  the  idea  that 
when  the  algorithm  starts  "close  enough  to  equilibrium"  it  should  not  lead  to 
a  "growing"  oscillation.  The  following  proposition  complements  Proposition  1 
and  suggests  that  the  bias  level  d(0)  should  exceed  a  certain  positive  value  in 
order  for  an  equilibrium  routing  or  node  to  be  locally  stable. 


Proposition  2;  a)  An  equilibrium  routing  R^  is  locally  stable  if 

i 

d(0)  >  max  {- 


where 


r.  N-l  /s  r.  N-l  ~ 

~5~  £  m.  ,  —  E  m.  } 

*=1  2  £=1  * 


m 


Jt^i-1 


=  max{d' (f) 

|f~(i-l)  <  f  <  fj  (i)}  , 

for 

Jt  =  1, . . . ,i-l 

=  max{d' (f) j 

1  f  1  fg-l 

for 

l  =  i+1, . . .  ,N 

=  max{d' (f) | 

\  (i)  <  f  <  f^  (i+1) } 

for 

l  =  1, . . . ,i-2 

=  max{d' (f) | 

fU!(i+1)  if  lfLl(i)} 

for 

1=  i, . . .  ,N-1 

where  d' (f)  denotes  the  first  derivative  of  d  at  f . 
b)  An  equilibrium  node  i  locally  stable  if 


r.  N-l  _ 
d  (0)  >  ~  Em. 

«,=! 


where 


i£  =  max{d'  (f)  |fj,(i)  <  f  <  f^(i+l)} 
i.  =  max{d'  (f)  |  f  £<i+l)  <  f  £  f  £(i) } 


for  il  =  1, . . .  ,i 
for  Jt  ”  i+1, . . .  ,N-1. 
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The  proof  of  Proposition  2  involves  a  straightforward  but  lengthy 
argument  and  will  be  ommitted.  It  can  be  found  in  [4]. 

Proposition  2  implies  that  in  order  to  ensure  local  stability  the  bias 
d(0)  should  exceed  a  level  that  depends  strongly  on  the  traffic  conditions. 

This  level  is  proportional  to  the  input  at  or  near  the  equilibrium  and  to  a 
global  measure  of  the  derivative  d'  along  the  ring.  Thus  it  may  be  necessary 
to  choose  a  value  of  d(0)  which  is  large  relative  to  r  and  d'  in  order  to 
ensure  stability  for  a  broad  range  of  input  traffic  conditions.  This  can  be 
accomplished  by  adding  a  larqe  constant  to  d.  On  the  other  hand  this  would 
introduce  a  tendency  in  the  algorithm  to  generate  routings  close  to  the  min- 
hop  routing  (i.e.  one  that  selects  routes  according  to  minimum  number  of  links 
to  the  destination) .  As  a  result  the  algorithm  would  tend  to  be  insensitive 
to  congestion.  This  tradeoff  will  be  reencountered  in  the  next  section 

The  point  of  view  that  has  been  adopted  in  this  section  is  one  whereby 
the  algorithm  is  viewed  as  a  dynamic  system  with  a  finite  number  of  states 
(the  finite  collection  of  [>ossible  routings) .  Unfortunately  the  study  of 
dynamic  behavior  and  stability  properties  of  such  systems  is  notoriously 
difficult.  To  begin  with  there  is  no  accepted  definition  of  equilibrium,  and 
in  fact  we  saw  that  in  the  ring  network  context  there  are  two  types  of 
"equilibria"  that  are  of  interest  -  equilibrium  routings  and  equilibrium  nodes. 
Furthermore  there  are  no  established  methodological  tools  that  can  be  helpful 
in  a  finite  state  system  framework.  As  a  result  our  progress  has  been  limited 
to  the  results  just  discussed.  We  are  thus  motivated  to  consider  approximation 
of  the  discrete  system  with  a  continuous  system  having  a  continuum  of  states. 
For  such  systems  there  is  an  effective  and  well  developed  stability  theory 
that  can  be  utilized  for  analysis.  We  take  this  approach  in  the  following 
two  sections  where  we  introduce  a  network  with  a  continuum  of  nodes.  Despite 


the  radical  nature  of  this  step  the  analysis  provides  informative  results 
and  clarifies  the  role  of  averaging  the  effects  of  several  past  routings  as 
a  means  of  damping  oscillatory  behavior.  The  validitv  of  our  approach  is  supported 
by  the  fact  that  qualitative  conclusions  drawn  from  the  continuous  node  model 
have  been  verified  computationally  in  finite  node  models. 

3.  A  Continuous  Model  of  a  Ring  network 

We  consider  a  continuum  of  nodes  arranged  in  a  ring  and  sending  traffic 
to  a  single  destination  as  shown  in  Figure  4. 


3/4 


Figure  4 

Points  on  the  ring  are  identified  with  their  distance  t  from  the  destination 
in  the  counterclockwise  direction,  where  t  is  normalized  to  take  values  in 
the  interval  [0,1].  Traffic  can  move  on  the  ring  in  both  directions. 

For  every  t  in  [0,1]  we  denote  by  r(t)  the  input  density  at  t.  The 
meaning  of  the  function  r  is  that  for  any  subinterval  [t  ,t  ]  °*  the 

total  input  traffic  originating  at  nodes  in  1 1 ^  » t2 1  is 
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r (t)dt 


t 


1 


We  assume  that  r  is  continuous  on  [0,1J  and  r(t)  >  0  for  at  least  on  te  (0,1) 

Note  that  a  network  with  a  finite  number  of  nodes  can  be  modelled  by  a  function 

r  containing  impulses  and  such  a  function  can  be  approximated  by  a  continuous 

function  consisting  of  narrow  triangular  pulses  of  finite  height.  We  are  interested 

in  routings  specified  by  points  y  in  [0,1],  where  the  flow  splits,  i.e. points 

larger  than  y  send  their  flow  counterclockwise  (or  in  the  positive  direction)  and 

points  smaller  than  y  send  their  flow  clockwise  (or  in  the  negative  direction  )  . 

To  a  given  function  r  and  routing  y,  there  corresponds  at  every  point  t  a  flow 

+  _ 

in  the  positive  direction  f  (y.t).  and  a  flow  in  the  negative  f"(y.t)  given  by 


y  <  t 


t  5  y 


(8) 


f  (y.t) 


0  if 


r(T)dT  if 


y  5  t 


t  f  y  . 


In  order  to  introduce  an  algorithm  such  as  (A)  in  the  framework  of 
the  continuous  model  we  consider  a  function  d  mapping  flows  into  the  non¬ 
negative  real  numbers.  The  meaning  of  d  is  that  given  a  routing  y  and  any 
point  t,  the  distances  D  and  D*  from  t  to  the  destination  in  the  negative 
and  positive  direction  are  given  by 

t 

<9>  D'(y.t)  -  P  d(f’(y,T)]dT 

0 

(10)  D+(y,t)  -  f1d{f+(y,T)]dT. 

**  t 


We  will  assume  that  d  is  a  monotonically  increasing  function  of  f  with  every¬ 
where  continuous  derivative.  We  further  assume  that  d(0)  >0.  As  Proposition  1 
shows,  the  case  where  d(0)  =  0  is  not  interesting  from  a  practical  point  of 
view. 

We  consider  the  following  algorithm  for  generating  routing  sequences 

(yk>: 


(Al)  Given  a  routing  y^,  the  next  routing  yk+1  is  the  solution  of 
the  equation 


un  D~<VW  =  D+(yk*W 

It  will  be  shown  as  part  of  Proposition  3  that  equation  (11)  has  a 
unique  solution  for  every  y^EIO.l].  Note  that  since  we  have 

D_(yk,t)  i  D'(yk'W  =  D+(VW  -  D+(yk»t)  if  -  yk+l 

and 

D"(yk't,  >  D"<yk'W  -  D+(VW  -  if  -  yk+i 

it  follows  that  a  routing  yk+1  determined  from  (11)  is  such  that  every  point  t 
routes  its  flow  in  the  positive  or  negative  direction  according  as 
D  (y^.t)  2.  D  (yk»t)  or  D  ^ykft^  —  D+^yjt't^»  i.e.  according  to  minimum  distance 
to  the  destination. 

We  say  that  y*  £[0,1]  is  an  equilibrium  if 
(12)  D(y*,y*)  =  D+(y*,y*)  . 


We  first  show  some  preliminary  results  relating  to  existence  and 
optimality  properties  of  equilibria: 


Proposition  3:  There  exists  a  unique  equilibrium  y* e  (0,1).  Furthermore 


equation  (11)  has  a  unique  solution  y^+^  for  every  y^. 


I 
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Proof :  Using  (9)  and  (10)  we  have  for  all  y  and  t 


(13) 


St 


We  have  d(0)  >0  and  d  is  monotonically  increasing, so  >  q  an(j 


St 

~  <  Thus  for  fixed  y,  the  function  D  (y,*)  is  continuous, 

monotonically  increasing  and  satisfies  D  (y,0)=0,  while  the  function 

D+(y,-  >  is  continuous  monotonically  decreasing  and  satisfies  D+(y,l)=0. 

Hence  the  equation  D  (y,t)  =D+(y,t)  has  a  unique  solution  in  t  lying  within 

(0,1).  Denote  by  g(y)  the  solution  corresponding  to  y.  The  function 

g:  [0, 1]“*[0,1]  can  be  easily  shown  to  be  continuous  and,  by  Brower's  fixed 

★  * 

point  theorem  ([8],  p.  161),  g  has  a  fixed  point  y  .  This  y  is  an 

*  *  *  * 

equilibrium.  If  there  exist  two  equilibria  y^  and  y 2  with  y^  <  y  then 
since  d(f)>  0  for  all  f>  0,  we  must  have 


★  * 


d  (y1,y1)<D  (y^.y^fo  (y* >y*)  3'D+(y2»y*) 

+  **  +  *  *  +  **  .** 
o  (y2,y2)<D  (y2,y1)fD  (y1,y1)=D  (y^yp 

which  is  impossible.  Hence  the  equilibrium  is  unique.  Q.E.D. 


Proposition  4:  The  equilibrium  minimizes  over  all  y  E  [0,1]  the  expression 

1 


J(y) 


=  |*plf+(y,t)  ]dt  +  fp 

*\)  Jo 


t) ]dt  +  p[f  (y,t) ]dt 


where  p  is  any  function  satisfying  for  all  f 

(14)  (f)  -  d(f) 

and  p'  denotes  the  first  derivative  of  p. 


Proof:  The  first  derivative  J'(y)  of  .1  is  given  by 


(19) 


J  (y ) 


p'  1  f +  (y ,  t)  )  dt  +  J  p*  [f"  (y,  t)  ]  dt 
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It  can  be  seen  from  (7)  and  (8)  that 


Combining  equations  (14)  -  (17)  we  obtain 


y  <  t 
t  <  y 

y  <  t 

t  <  y 


J-  (y)  * r(y) t  -/Jd[f+(y,t)]dt+  jyd[f'(y,t)]dtj, 
or  equivalently 

J'(y)-r(y)[D  (y,y) -D+(y,y)] . 

* 

If  y  is  an  equilibrium  it  can  be  seen  that  we  have 


D"(y,y)  s  D+<y,y) 

if 

y  s 

o’(y.y)  >  o+(y,y) 

if 

y  > 

Thus  J’(y)  ^0  if  y  <^y*,  J' (y)  ^0  if  y*  jcy,  and  J'  (y*)  =  0. 

It  follows  that  y *  minimizes  J.  Q.E.D. 

Proposition  4  shows  that  one  can  minimize  the  integral  of 

average  delay  over  the  ring  by  choosing  the  function  d  to  be  marginal 

delay  and  by  guaranteeing  that  the  algorithm  converges  to  an  equilibrium. 

The  needto  use  marginal  delays  as  link  lengths  in  order  to  minimize  total 

average  delay  has  been  pointed  out  earlier  in  a  different  algorithmic 

context  19].  The  following  discussion,  however,  casts  doubt  as  to  whether 


the  algorithm  will  converge  to  an  equilibrium  when  the  link  lengths  are 
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chosen  to  be  the  marginal  delays.  In  any  case  Proposition  4  suggests  that 
convergence  of  the  algorithm  to  an  equilibrium  is  desirable  since  a  function 
p  satisfying  (14)  is  monotonically  increasing  and  convex  and  hence  an 
equilibrium  will  at  least  be  a  reasonably  good  routing  even  if  it  is  sub- 
optimal  in  terms  of  a  particular  design  objective. 

We  now  consider  the  convergence  properties  of  the  algorithm.  For 
any  ye [0,1]  we  denote  by  g(y)  the  unique  solution  in  t  of  the  equation 
D~(y,t)  =  D+(y,t)  (c. f. Proposition  1).  Thus  Algorithm  (Al)  can  be  written 

as)  yk+1  =  g(yk>. 

We  have  for  all  ye [0,1] 

rg(v)  ri 

(19)  D~[y,g(y)]  =  (  d [f~ (y,t) ]dt  =  [  d  [f+ (y ,  t)  ] dt  =  D+ [y  ,g  (y )  ] 

Jo  Jgiy) 

We  evaluate  the  first  derivative  g*  (y)  =  for  ye(0,l).  Dif ferentiation 

in  (19)  yields 


<?(  y) 


J  d'[f  (y,t)]dt  +  d[f“(y,g(y)))g’  (y) 

**0 


or 


(20) 


g'  (y)  = 


r 1  +  + 

I  d' (f  (y , t) ] dt  -  d[f  (y,g(y) ) ]g' 
Jg(y) 

n  rg(y) 

d'  [f+(y,t)]dt  -  d’ 

J  g(y)  Jo 


(y) 


[f  (y ,t) ]dt 


d [ f  (y,g(y))]  +  d[f  (y,g(y)))] 


We  have  for  t  ^  y 


(21) 


3d[f  (y ,t) ] 
9y 


d'  (f+(y,t) ]  — 


(y,t) 


9y 


(22) 


9d[f  (y , t)  ] 
9y 


d' [f  (y, t) ] 


9f~ (y ,t) 
3y 
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Combining  (20)  -  (22)  with  (16) ,  (17)  we  obtain 


(23) 


min{y,g(y) } 

_ d[f-<y.t)|dt  +  J‘„>>{yia(v>)<a'  lf*(y.t)]dt] 

d[f  (y,g(y))l  +  d [f+ (y,g (y) ) ] 


At  the  equilibrium  y*  we  have  y*  =  g(y*)  and  f  (y*,y*)  =  f  (y*,y*)  =  0,  so 
(23)  yields 


(24) 


g'  (y*) 


•  (VM  =  - 


r(y*)  (  I*.  d'[f  (y*,t)]dt  +  f  d'[f+(y*,t)] 

•'U 


dt 


2d  (0) 


By  using  a  theorem  of  Ostrowski  ([8],  pp.  300-301)  we  can  state  the  following 
local  convergence  and  rate  of  convergence  result  for  algorithm  (Al) . 


Proposition  5:  Let  y*  be  the  equilibrium.  Then  if  |g'(y*)|  <  1  or 
equivalently 


(25) 


d(0) 


r  (y*) 


</r 


£ 


d' [f  (y*,t)]dt  +1  ,d' (f  (y* ,t) ]dt] 


there  exists  an  open  interval  I  containing  y*  such  that  if  y^CI  the  sequence 
{yR}  generated  by  algorithm  (Al)  remains  in  I  and  converges  to  y*.  Further¬ 
more  if  y^  ^  y*  for  all  k  there  holds 


(26) 


1  yk+l  *  1  ,  4lk 

lim  sup  — - — | —  =  lim  sup  y,  -  y* 

k-K»  yk  -  y*l  k-*»  1  k 


|g' (y*) I 


When  the  equilibrium  y*  has  the  property  specified  in  the  first  conclusion 
of  Proposition  5  we  say  that  it  is  locally  stable.  If  |g'(y*)[  >  1  then  the 
linearized  system  corresponding  to  yk+1  =  g(yk)  is  unstable,  so  the 
algorithm  tends  to  diverge  from  y*  when  started  close  to  it.  Notice  the 
similarity  of  equation  (25)  with  the  corresponding  local  stability  conditions 
for  finite  node  networks  (cf.  Proposition  2). 
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A  sufficient  condition  for  global  convergence  of  algorithm  (Al) 
can  be  obtained  by  requiring  that  g  be  a  contraction  mapping,  i.e.  for  some 
p€(0,l)  there  holds 

(27)  ig(y)  -  y*|  s  p iy -y*l»  ,  %€{o,i]. 


From  Taylor's  theorem  and  the  fact  g'  (y)  <  0  we  have 


|g(y)  -  y 


1=  I  fg' 


(z)dz 


Let 


p  =  max  ^  d'  (f ) 

O^f^J  r (t)dt 
0 

From  (23)  we  obtain  for  all  z 


W  (z) 


s  ^r(z)[l  -  iz  -  g(z)  1] 

2d(0) 


Thus  (27)  is  satisfied  if 


sup 

y€ro,iJ 
y  t  y 


2d(0) 


i)  * 


r  (z)  [  1  -  {z  -  g(z)  (]dz 


y  -  y 


<1 


or  equivalently  if 

(28) 


d(0)  sup 

y€£0, 1] 
* 

yty 


fy  r (z) [ 1  -  |z  -  g(?)| ]dz 

iz! _ 

* 

y  -  y 


L 


This  will  be  true  in  particular  if 


(29)  d(0)  >  f 

where  R  =  max  r(t).  The  conclusions  of  the  preceding  discussion  are 
0  s  t  s  1 

summarized  in  the  following  proposition. 

Proposition  6:  If  condition  (28)  or  the  stronger  condition  (29)  holds, 

every  sequence  {y  }  generated  by  algorithm  (Al)  converges  to  the  equilibrium  y*. 


When  the  equilibrium  y*  has  the  property  specified  in  Proposition  6  we 
say  that  it  is  globally  stable. 

In  order  to  put  the  results  obtained  thus  far  in  better  perspective 
let  us  write  d(f)  as 

-'S 

d (f )  =  a  +  d(f) 


where  a  =  d(0)  represents  the  bias  factor.  For  fixed  input  density  r  we 

have  that  to  each  positive  value  of  bias  a  there  corresponds  an  equilibrium 

* 


y^  .  The  equilibrium  is  locally  stable  for  a  satisfying  [cf.(25)] 


(30) 


a  > 


Jl“  O'lf'lVtlldt  ♦  P,  dMfhy^Oldt]  _ 


2 

and  globally  stable  fora  satisfying  Icf.(29)] 


(31) 


Br 

2 


As  a  increases  the  corresponding  equilibria  tend  to  become  stable.  Further¬ 
more  from  (24)  and  <?(-)  it  can  be  seen  that  the  speed  of  convergence  of  the 
algorithm  is  accelerated  as  a  increases.  On  the  other  hand  it  is  easy  to  see 
that  ya  ->  —  as  a*'*’,  *nich  in  the  context  of  the  routing  problem  means  that 
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the  algorithm  becomes  incr<  nsingly  insensitive  to  congestion  as  ci-*®0 

Since  in  a  practical  situation  we  are  interested  in  the  stability  Properties 
of  the  algorithm  for  a  broad  ranqe  of  inputs  let  us  consider  input  densities 
of  the  form 

(32)  r,  (t)  =  Ar  (t) 

where  A  is  a  positive  parameter.  Then  it  is  clear  that  as  A  increases  a  larger 
value  of  bias  is  necessary  in  order  to  stabilize  the  algorithm. 

For  example  if  d  is  of  the  form 

(33)  d  (f )  =  a  +  Rfn 

where  3>0,  n>0  then  from  (3)  and  (31)  we  see  that  if  r  is  changed  to  Ar 
as  in  (32),  then  the  stabiliiv  threshold  level  of  the  bias  is  multiplied  by  An. 
Thus  for  fixed  a  and  r  there  is  a  choice  of  A  for  which  the  corresponding 
equilibrium  is  unstable.  Incidentally  the  expression  (33)  for  d  has  an 
interesting  property,  namely, that  the  set  of  all  possible  equlibria  {ya|a>0} 
as  well  as  the  set  of  all  locally  or  globally  stable  equilibria  is  independent 
of  the  level  of  input  A  and  depends  only  on  r.  This  is  straightforward  to 
verify  using  (33)  and  the  fact  that  if  r  is  changed  to  Ar  and  a  is  changed 
to  \n a  then  the  routing  sequences  generated  by  the  algorithm  are  unaffected. 

Choosing  the  Bias  as  a  Function  of  the  Current  Routing 

Since  stability  of  the  algorithm  depends  strongly  on  the  level  of  bias 
and  the  level  of  input  we  are  motivated  to  consider  schemes  where  the  bias 
is  not  held  fixed  but  in  rather  adjusted  adaptively  on  the  basis  of  currently 
available  information.  An  interesting  scheme  is  to  use  a  length  function 


of  the  form 
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<uf .  v )  L  i  (y )  +  d  if ) 

wi.eu  d  i„-  a  coni  i  raously  differentiable,  monotonically  increasing  function 
with  d (0)  C,  ..nd  a(y)  is  taken  to  bo  some  monotonically  nondecreasing 

function  of  l)  •,  /)  given  bv 

'  '  r1  ~  - 

;  .  )  •  dlf  (y,t)]dt  +j  d[f  (y , t)  ] dt . 

J  ,>  Jo 

So"  e  a  • ...  i  •  function  of  the  form 

2 

|.b!  1 1 y )  >  •'  ■  ,  s..,(y)  +  Y0lb.,(y)  ] 

O  .1  /.I 

a  .n  cine  ...  xuerimentally  determined  nonnegative  constants 

ioeius  suitable.  ,  n  mo  context  of  a  finite  node  network  with  not  necessarily 
a  r -m;  structure  a  scheme  like  this  can  be  very  easily  implemented.  In  this 
rase  D  (y)  can  be  calculated  as  the  sum  of  all  reported  link  "delays" 

,i.  The  bias  <.  < y )  can  be  computed  by  each  node  via  a  formula  such  as 

'<  A, 

A 

(34}  and  the  link  length  can  be  computed  as  =  <*(y)  +  d(f^)  . 

A  sehmio  of  the  type  just  described  can  be  analyzed  along  similar  lines 
as  earlier  in  this  sort  ion.  It  has  been  tested  in  quite  extensive  numerical 
experiment:,  ir.voivj.ng  finite  node  networks  and  it  was  shown  to  have  very 
satisfactory  performance  [4],  [3],  This  can  be  attributed  to  the  fact  that 
rV  level  of  bias  increases  or  decreases  with  the  level  of  input  thus 
providing  automat  it:  staling  with  respect  to  input  level.  In  fact  it  can  be 
easily  am  that  if  d  lias  the  form  d  (£)  =  Bfn  where  B>0,  n>0  and  we  choose 
j(y)  YDn,(y)  where  y  -0.  then  for  every  input  density  function  of  the  form 
'  c  <X.)  ,  1  ,  the  s*  .  .  .  .  .  !.  generated  by  the  algorithm  do  not  depend  on  A. 
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4.  Averaging  the  Effect  of  Several  Routings 

In  this  section  we  show  that  the  stability  properties  of  the  shortest 
path  algorithm  of  the  preceding  section  can  be  improved  if  link  lengths  suitably 
depend  on  flows  corresponding  to  several  past  routings.  There  are  several 
possibilities  along  these  lines.  Some  examples  are  as  follows: 

a)  Averaging  over  the  present  and  the  past  n  routings. 

Given  a  sequence  of  past  routings  ^  r  •  •  •  »  we  define  for  any 

t  in  [0,1]  "averaged"  distances  to  0  and  1  by 


(35)  6'(y  y  ...,y  t)  =  J  SI  S. 

0  i=0 


(36)  E^(yk'yk-r*---'}'k_n>t>  =  J  .r  d[f+(y  ,  T)]dT 

n+j.  l— u  •*'-  i 

1  s 

Thus  distances  are  calculated  by  integrating  ^=od^^yk  3  »  which  is 

an  averaged  length  over  the  routings  in  place  of  d[f(y^,T)] 

which  is  the  length  corresponding  to  the  last  routing. 

The  new  routing  yk+^  i-s  obtained  from  the  equation 

(37)  5‘(yk’yk-l’  •  ’  •  ’Vn’W  =  D\’yk-1"  •  •  *yk-n* W  • 

It  is  easily  seen  that  this  defines  uniquely  y,  .  in  terms  of  y,,y,  y, 

Kt  i.  iC  R”  i.  k-n 

As  earlier  we  write  the  corresponding  equation  as 


'k+1 


g(y^.y 


k’^k-l 1 


’yk-n>- 


A  routing  y  is  said  to  be  an  equilibrium  if 


(38) 
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■k  *  *  * 

y  =  g(y  ,y  )• 


It  is  clear  that  y  is  an  equilibrium  In  this  sense  for  a  given  bias  level 
if  and  only  if  it  is  an  tv(uil  i briuin  in  the  sense  given  in  the  preceding 
section. 

•k 

We  can  define  Local  stability  of  y  in  the  obvious  way.  We  have 

* 

that  y  is  locally  stable  il  it  is  also  a  stable  equilibrium  of  equation 
(38)  linearized  around  y  (see  [8]  p.  353).  It  is  a  known  fact  that  this  is 
true  if  all  roots  of  the  characteristic  polynomial 


C(P) 


..  n+1  .  J klvJ.  «  .  n-1 

<>yk  oyk- 1 


k  k 

_  fety.J  _  c>8(y  ) 

^yk-n+l  ^k-n 


lie  inside  the  unit  circle,  (i.c.  have  modulus  less  than  unity).  We  cal¬ 


culate  the  derivatives  - 


i >JL 


oyk-i 

We  have  for  a>0  similarly  as  earlier  for  every  i 

k 

=  '  dMf'(y‘,t)ldt  +j‘  *  d 1  ff +  (y* ,  t)  ]  dt} 

k- i  '  U  y 


Define 

* 

*3  -y  >l 

<39)  <1*  tf"(y*,t)]dt  +  j  d'[f+(y*,t)]dt} 

q  y 

k 

Note  that,  from  Proposition  5,  y  j.s  locally  stable  for  algorithm  (Al)  if 
p.<l.  The  characteristic  polynomial  can  be  written  as 


(40) 


.  n+i  p  ii  ti  n-1  u  u 

C(P)  "P  +  n+1  P  +n+l  P  +  +  p+  TSr  * 


We  now  use  im  inflowing  fact: 

Lemma:  Let  £  be  a  posit ivi  scalar  and  n  be  a  positive  integer.  The  roots  of 
the  polynomial 


gw 

r 
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n+ 1  -  n  -  n  - 1  -  .  _ 

p  p  +  ip  +  . . .  +  Sp  +  S 

lie  inside  the  unit  circle  if  and  only  if  L<1. 

Proof :  This  result  can  be  shown  by  straightforward  application  of  Jury's 
stability  test  ([10],  p.  97-98).  Q.E.D. 

We  now  apply  the  result  of  the  lemma  to  our  problem.  We  have 

: k 

that  the  equilibrium  y  will  be  locally  stable  if 

p.  ^  n  +  1. 


It  follows  using  (39)  that  in  the  averaged  algorithm  the  bias  level  must 

satisfy  *  y*  l 

r(y  ){  ,  ci  *  I  f  ~  (y*  ,  t ) )  dt  +  d’  +  ]  dt  ] 

d  (o)  > _ _ _ 9 _ i _ 

2 (n+1) 

• k 

in  order  for  the  corresponding  equilibrium  y  to  be  stable.  If  we  compare 
this  with  the  earlier  algorithm  [cl.  (2S)]  we  see  that  in  the  averaged 
algorithm  the  bias  threshold  level  for  stability  is  reduced  by  the  tactor 

— j-  over  the  one  of  algorithm  (Al).  For  a  given  traliic  input,  and  any 
given  bias  level  the  corresponding  equilibrium  can  be  made  stable  by 
averaging  delays  over  a  sufficiently  large  number  of  periods. 

Regarding  rate  of  convergence,  Ostrovski's  Theorem  again  applies. 


We  have  from  the 

proof  of  Tli  -  10.1.3  of 

[8] 

that 

given  any  ^  0  there 

exists  a  norm 

on  R11"^  such  that  if  y. 

*  y~ 

f  or 

all  V 

lim  sup 
k  —  " 


(yk+ry’---’yk -n+ry  } 

k  * 

(y,  -y  , . .  .  ,y.  „-y  ) 


P(K,n)  4  (  , 


where  P(h,n)  is  tlie  maximum  root  modulus  of  the  characteristic  polynomial 
C(p)  of  (40).  It  can  he  seen  that  for  fixed  n  we  have  p((*,n)  "0  as  “O, 
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If  Pi»***>Pn+i  are  the  roots  of  C(p)  we  have  »  so  that 
P*  n+1 

P(jJ.,ni)  *  ^rvHhT )  ‘  £t  ^°^^ows  that  for  fixed  p.  we  have  p(p.,n)  —  I  as  n-*®, 
so  that  the  rate  of  convergence  deteriorates  as  n -®.  Thus  too  much  damp¬ 
ing  can  slow  down  the  speed  of  convergence  of  the  algorithm. 


b)  Fading  Memory  Scheme 

This  scheme  is  similar  to  the  preceding  one  except  that  the  lengths 
corresponding  to  all  past  routings  are  averaged  via  a  fading  memory  scheme.  Given 
the  sequence  of  all  past  routings  {y^,yf,_1 , - . . } ,  the  next  routing  yk+1  is 
determined  as  the  solution  of  the  equation 


(41) 


*  k+1 

j  \(t)dt 
0 


=  C'  + 
P  v.  .  k 


(t)  dt 


yk+l 


where  6^  and  6^  are  obtained  by  the  following  recursive  fading  memory 
scheme  with  decay  factor  p€[0,l) 


6k(t)  =  *Vi(t)+  (l  • c)d 

6k(t)  =  36k-l(t)+  (1  -  P)d[f+(yk,t)]. 


Alternatively  we  can  write 

k  . 

(42)  6‘(t)  =  (1-0)  p  _1d[f'  (y L » t ) J 

(43)  6+(t)  =  (1-0)  ek_id[f'h(yi  ,t)j  . 

Let  us  write  the  solution  of  (46)  as 

(44)  yk+1  -  g(yk,yk.r...,). 

Let  us  also  consider  the  linear  system  obtained  by  formal  linearization  of 

k 

(44)  around  the  equilibrium  y  .  We  have  similarly  as  earlier  that  this 
linearized  system  is 

<45)  yk+1  -  -p(i-e>[yk  +  Pyk.L  +  e2yk_2  +  •••]■ 
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r 


where  p.  is  given  by  (39).  Let  us  denote 


Zk+1  =  yk  +  Pyk-1  +  P  yk-2  + 


Then  we  have  for  all  k 


yk+i  =-Ki-&)yk  - 


zk+l  =  yk  +  &zk 


and  it  follows  that  the  linearized  system  (45)  is  in  effect  the  two- 
dimensional  system  described  by  (46)  and  (47).  This  latter  system  is  stable 
if  both  eigenvalues  of  the  system  matrix 


-mi-&)  -n(i-g)3 


lie  within  the  unit  circle.  These  two  eigenvalues  can  be  calculated  to  be 
0  and  $-p>(l-0).  It  follows  that  the  linearized  system  is  stable  if 


Although  we  do  not  provide  a  proof,  it  is  possible  to  establish  rigorously 
that  stability  of  the  linearized  system  (45)  implies  local  stability  of 
the  algorithm  (44)  and  thus  we  have  the  result  that  the  threshold  value  of 
bias  for  stability  in  the  f-  ling  memory  scheme  is  reduced  by  the  factor 
Y^-|  over  the  one  of  algorithm  (Al).  The  optimal  speed  of  convergence  is 
obtained  when  the  eigenvalue  p  -  p(l  -  p)  equals  zero  in  which  case  a  super- 


linear  rate  of  convergence  is  obtained.  This  is  so  when  r  - 


For  other 


values  of  P  in  the  intcrvaL  (- — — r  ,  1)  the  rate  of  convergence  is  linear,  and 

L  +  1 
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for 


V-l 

y+1 


value 


l+w 


the  equilibrium  is  unstable.  As  6  is  increased  from  the  optimal 
towards  unity  the  rate  of  convergence  deteriorates. 


c)  Asynchronous  Length  Reporting 

This  type  of  scheme  is;  patterned  after  a  shortest  path  routing  algorithm 
where  nodes  report  asynchronously  the  lengths  of  their  outgoing  links  and  the 

shortest  paths  are  updated  after  each  report.  The  set  of  nodes  10,1]  is 

partitioned  into  n  subsets  which  we  call  , S2 , . . . , .  At  some  time,  say  0, 

the  nodes  in  report  their  lengths  averaged  over  the  flows  corresponding  to 
the  preceding  n  routings  and  a  routing  update  takes  place.  Then  at  time 
0^  >  0  the  nodes  in  do  the  same  thing.  Similarly,  for  i  =  l,...,n-l,  at 
time  (0,  +  0  +  ...  +  0.)  the  nodes  in  S.  ,  do  the  same  thing.  At  time 
(0^  +  o2  +...+o  >  the  nodes  in  again  report  their  lengths,  an  updating 
takes  place  and  the  process  is  repeated.  This  type  of  asynchronous  operation 
is  currently  in  use  in  the  ARPANET  [4]  where,  in  a  finite  node  network 
context,  consists  of  a  single  node  for  all  i.  There  are  also  other 
variations  of  asynchronous  operation  involving  for  example  averaging  over 
all  preceding  routings  via  a  fading  memory  scheme.  This  type  of  algorithm 
is  described  and  tested  computationally  in  [4]  and  [3].  The  analysis  of 
all  these  schemes  is  very  similar  as  that  of  the  averaging  schemes  described 
earlier  in  this  section.  The  details  are  quite  messy  and  may  be  found  in 
[4],  where  it  is  shown,  via  analysis  and  computational  experiment,  that 
asynchronous  operation  has  a  substantial  beneficial  effect  on  the  stability 
properties  of  the  shortest  path  algorithm. 


5.  The  Case  of  a  Network  with  an  Arbitrary  Topology 


The  extension  of  the  continuous  model  to  the  case  of  a  network  with 


V 
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arbitrary  topology  is  quite  straightforward.  However,  the  notation  required 
for  a  precise  mathematical  description  is  very  cumbersome  and  tends  to  cloud 
the  main  ideas.  For  this  reason  our  pt  scntation  will  be  somewhat  informal. 

Consider  the  case  of  an  undirected  network  with  a  single  destination. 

Let  r  be  the  input  density  function  mapping  points  on  the  undirectred  links 
of  the  network  to  the  nonneqative  real  numbers.  The  meaning  of  r  again  is 
that,  given  any  interval  I  on  a  link,  the  total  traffic  input  originating 
at  this  interval  is  the  integral  of  r  over  I.  We  view  the  set  of  points  on 
the  network  as  a  subset  of  a  Fuclidean  space  of  appropriate  dimension,  and 
assume  that  r  is  a  continuous  function.  In  order  to  consider  notions  of 
length  we  associate  witli  each  undirected  link  (i,P)  two  directions  i-*-f  and 
4vi.  (There  may  be  more  than  one  links  connecting  a  pair  of  nodes  within 
our  framework.  When  we  refer  to  a  link  (i,P)  we  mean  a  particular  link 
connecting  i  and  l  and  specify  further  when  there  is  danger  of  confusion). 

A  length  function  is  a  function  which  assigns  to  each  point  on  an  undirected 
link  ( i ,  fi, )  two  nonneqative  numbers  one  associated  witli  the  direction  i 
and  the  other  associated  with  the  direction  (’►i.  We  assume  that  *S  is  piece- 
wise  continuous  along  every  link  in  each  direction.  The  meaning  of  6  is 
that  given  any  two  points  on  a  link  ( i , C  3  their  distance  in  the  direction  i * f 
is  obtained  by  integrating  iS  as  defined  in  that  direction  between  the  two 
points.  The  distance  in  the  opposite  direction  f *)  is  defined  analogously. 
Similarly  wo  can  consider  paths  between  points  on  possibly  different  links 
and  define  their  length  in  one  or  the  other  direction. 

We  now  associate  to  a  given  length  function  A  a  shortest  path  of  every 
{joint,  and  an  associated  rout  mg.  We  a.esuim  that  A  is  everywhere  }«>:. it  ive. 


(liven  any  {joint  we  mn:  idet  tie-  <■  .Meet  inn  of  paths  to  the  dost  i nat  lot.  and 
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their  associated  distances  specified  by  the  function  6.  A  path  of  minimum 
distance  is  referred  to  as  a  shortest  path  from  the  point  to  the  destination, 
and  the  corresponding  distance  is  referred  to  as  the  shortest  distance  of 
the  point  to  the  destination.  The  routing  corresponding  to  6  is  the  set 
of  points  for  which  there  are  more  than  one  equidistant  paths  to  the 
destination.  A  routing  is  said  to  be  regular  if  it  does  not  contain  any 
nodes  of  the  network,  otherwise  it  is  said  to  be  singular. 

Given  the  function  6  ,  a  shortest  path  of  each  point  and  the  corres¬ 
ponding  routing  can  be  constructed  in  a  simple  manner  along  similar  lines 
as  for  usual  networks.  We  first  construct  a  shortest  path  tree  for  the 
network  in  the  usual  manner  by  using  as  (directed)  link  lengths  those  speci¬ 
fied  by  the  length  function  6.  (The  length  of  the  directed  link  (i,X)  is 

the  integral  of  b  along  (i,i)  in  the  direction  i-X).  This  gives  us  a 

shortest  path  and  the  associated  shortest  distance  for  every  point  on  the 
shortest  path  tree  including  all  the  nodes  of  the  network.  A  shortest  path 

for  points  on  links  that  are  not  part  of  the  shortest  path  tree  can  be 

obtained  as  follows: 

Let  (i,X)  be  a  link  that  is  not  on  the  tree.  Let  D£  and  be 
the  shortest  distances  of  nodes  i  and  X.  The  shortest  distance  of  a  point 
t  on  (i,^)  is 

i  X 

D(t)  -min  {D.  +j‘  &Xi(T)dt ,  D£  +  j  6u(T)dtJ 

where  6  is  6  in  the  direction  X— i  and  6  is  6  in  the  direction  i  "*  X. 

Xi  i* 

It  can  be  seen  that  the  routing  corresponding  to  6  is  regular  if  and  only 
if  each  (ordinary)  node  of  the  network  has  only  one  shortest  path  associated 
with  it.  If  a  routing  is  regular  then  every  one  of  its  points  Ilea  in  the 


"interior"  of  some  link.  Notice  that  the  preceding  construction  shows  that 
a  routing  (regular  or  not)  consists  of  (L  -  N  +  1)  points  where  L  and  N  are 
the  number  of  undirected  links  and  nodes  respectively. 

Given  a  shortest  path  tree  and  the  corresponding  routing  constructed 
as  just  described,  we  can  define  the  flow  corresponding  to  it.  At  each 
point,  say  t,  of  a  link  (i,£)  there  are  two  flows  to  consider  (one  of  which 
is  zero);  the  flow  in  the  direction  i+J?,  and  the  flow  in  the  direction  P-*-i . 
Each  is  defined  in  the  natural  way  by  integrating  the  input  density  function 
r  over  the  portion  of  the  network  that  lies  "upstream"  from  the  point  t, 
i.e.  over  the  set  of  points  the  shortest  paths  of  which  meet  t  on  their  way 
to  the  destination.  At  the  points  of  a  regular  routing  the  flow  is  zero  in 
either  direction.  Notice  that  if  6  is  such  that  the  corresponding  routing 
is  regular  the  flow  is  uniquely  determined  by  .  Otherwise  the  flow  will 
depend  not  only  on  6  but  also  on  the  shortest  path  tree  selected. 

Suppose  we  are  given  a  monotonically  increasing,  continuously 
differentiable  function  d  mapping  flow  into  the  positive  numbers.  Given  a 
shortest  path  tree  T  corresponding  to  a  length  function  <S  with  routing  Y  we 
can  define  a  new  length  function  Z  which  assigns  to  points  t  in  any  one  of 
the  two  possible  directions  the  length  <S(t)  =  d [ f { t ) ]  where  f (t)  is  the 
flow  at  t  corresponding  to  <S  and  T  in  the  appropriate  direction.  The 
corresponding  routing  is  denoted  Y.  Note  that  if  Y  is  sinqular  then  iS  and 
Y  depend  not  only  on  6  but  also  on  T.  If  Y  is  reqular  then  Y  is  uniquely 
determined  by  $  . 

We  are  now  in  a  pfjc.it ion  to  define  an  algorithm  similar  to  the  one  of 
Section  3.  Given  a  length  function  <Sn  and  a  corresponding  shortest  path 
tree  T  and  routing  Y(),  the  next  length  function  is  *  ••  ?  with  corresponding 
routing  Y^  =  Y^.  A  shortest  path  tree  corresponding  to 


is  Selected 


and  is  used  to  define  similarly  6^ ,  Y^  and  •  Similarly  the  algorithm 

generates  6^,  Y^  and  for  all  k. 

We  say  that  a  routing  Y*  corresponding  to  a  length  function  6*  and 

— *  — * 

shortest  path  tree  T*  is  an  equilibrium  routing  if  6=6*  and  Y  =  Y* . 

Contrary  to  the  case  of  a  ring  network  where  we  were  able  to  prove 
existence  of  an  equilibrium,  in  general  there  need  not  exist  an  equilibrium. 
This  fact  is  demonstrated  in  the  following  example  and  provides  an  indication 
of  the  complexity  of  the  dynamic  phenomena  that  we  are  investigating. 

Example :  Consider  the  network  shown  in  Figure  5. 


Figure  5 

There  are  two  nodes  1  and  2  and  three  links  connecting  them  denoted  by 
A,B,C.  Node  2  is  the  destination.  Points  on  A,B,  and  C  are  parameterized 

by  their  Euclidean  distance  to  the  destination.  The  Euclidean  lengths  of 
A,B  and  C  are  all  taken  equal  to  unity.  Let  the  input  density  function  be 


as  follows 
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For  link  A:  r(t)  =  1,  Vt€[0,l] 

For  link  B:  r(t)  =  r^,  Vt€[0,l] 

For  link  C:  r(t)  =  rc ,  Vt€[0,l]. 

We  assume  that  l^r  sr  ,  l<r  .  Let 
d  L  L 

d(f )  =  “  +  f 

where  >  0  is  the  bias  factor. 

In  view  of  the  fact  1  <  r  <  r  ,  l<r  ,  it  is  clear  that  an  equilibrium 

—  B  —  C  C 

routing  cannot  contain  a  point  in  the  interior  of  link  A,  while  it  must 
contain  a  point  in  the  interior  of  link  C.  We  consider  two  cases: 

Case  Is  r_  =  1.  Then  an  equilibrium  routinq  cannot  contain  a  point  in  the 
interior  of  link  B  so  the  only  candidate  for  equilibrium  are  the  two  types 
of  singular  routings  shown  in  Figure  6.  In  routings  and  Y^  the  incoming 
traffic  at  node  1  is  routed  through  link  A  and  link  B  respectively.  None 
of  the  two  routings  can  be  an  equilibrium.  In  routing  Y^  there  will  be  points 
in  the  interior  of  link  A  which  will  have  a  shorter  distance  to  the  destination 
(corresponding  to  Y^)  through  link  B  rather  than  through  A,  and  the  reverse 
situation  occures  in  routing  Y  .  Notice  that  this  argument  makes  use  only 
of  the  magnitude  of  r  and  r^  and  is  independent  of  the  form  of  the  function  d. 

Case  2:  l<r„.  Then  it  can  be  seen  that  the  only  candidates  for  equilibria 

B 

are  routings  of  the  form  shown  in  Figure  7.  Each  equilibrium  routing  candidate 


i 
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is  specified  by  the  points  y  ,  y  €[0,1]  where  the  flow  separates  on  links  B  and 

B  C 

C.  We  have  that  the  distances  D  (yfi) ,  D  (yR)  of  yr  corresponding  to  routing 


B 


(y  ,y  )  along  the  counterclockwise  and  clockwise  paths  respectively  are  given 
B  C 


by 


D’<yB)  =%  +  rBJr0B(yB't)dt 


D  (yB)  =  (2  -yB)c*+rBj  (t-yB)dt 

yB 


+  j  '  yB)  +  rC(L  '  yC}  +  (l  ‘  t)ldt 


if  (yn.yn)  is  an  equilibrium  we  must  have 
o 


D  (yB)  =  D  (yB) 


which  after  some  calculation  can  be  written  as 

rB  "  1 

(48)  2(af  +  rB)(l.yB)+rcCl-yc)=-2j— 


By  symmetry  the  equation  D  (y  )  =D  (y  )  can  be  written  as 

C  L 


(49) 


Equations  (48)  and  (49)  are  in  fact  necessary  and  sufficient  conditions  for 
(yD,y„)  to  be  an  equilibrium  routing.  Thus  there  exists  an  equilibrium 

D  I* 

*  ★ 

routing  if  and  only  if  the  solution  (y_,y„)  to  these  equations  satisfies 

D  L 

yBt[0,lj ,  y^€[0,l].  After  some  calculation,  this  condition  can  be  shown  to 
be  equivalent  to 


or  Jt  - 


rC(2rB“rC-1) 


(50) 


2(rB-l> 


If  2r  >  r  +  1  then  for  every  level  of  bias  there  exists  an  equilibrium  rout- 
ing  <yD/  y„) •  If  however  2rD  <  r  +  1  then  there  exists  an  equilibrium  only 
for  a  above  the  threshold  level  indicated  in  (50) . 

The  preceding  example  shows  that  existence  of  an  equilibrium  can  depend 
on  both  the  level  of  bias  and  the  input  density  function.  Furthermore,  it 
may  happen  that,  for  a  given  input  density  function,  no  value  of  bias  can  be 
found  for  which  an  equilibrium  exists.  This  last  phenomenon  is  of  a  singular 
nature  and  is  due  to  the  fact  that  the  Euclidean  lengths  of  links  A,B,  and  C 
are  all  equal  to  unity.  To  see  this  consider  the  routing  Y^  corresponding 
to  the  length  function  6+(t)  E  1,  6  (t)  E  1.  The  routing  Y^  is  analogous 
to  the  min-hop  routing  in  discrete  node  networks,  and  can  be  associated  with 
infinite  level  of  bias.  It  is  an  equilibrium  routing  for  the  case  d(f)  El. 

If  Ym  is  a  regular  routing,  i.e.  each  node  has  a  unique  minimum  Euclidean 
distance  path  to  the  destination,  then  it  is  clear  that,  for  any  given  input 
function  r,  there  exists  a  threshold  level  of  bias  a  such  that  for  all 
a  >aa  regular  equilibrium  routing  exists. 

Characterizing  the  dynamic  behavior  of  the  algorithm  in  the  absence 
of  an  equilibrium  is  certainly  an  interesting  problem  but  we  have  been  un¬ 
able  to  make  much  progress  in  this  direction.  Computational  results  for 
finite  node  networks  given  in  [3]  suggest  that  the  stability  properties  of 
the  algorithm  are  improved  by  high  level  of  bias  and  averaging  similarly 
as  in  the  presence  of  an  equilibrium.  in  what  follows  in  this  section  we 
restrict  attention  to  the  case  where  a  regular  equilibrium  routing  exists. 

Given  a  regular  equilibrium  routing  Y*  =  (y*, y* , •  •  •  rV* }  consider 

1  2  n 

for  j  =  l,2,...,n  the  link  (i.,S,.)  containing  y*  and  the  two  shortest  paths 

3  1  j 

from  y|  to  the  destination.  A  simple  but  fundamental  observation  is  that 
these  two  paths  join  at  some  jxiint  thereby  forming  a  ring  of  the  type  con- 


sidered  in  Section  3.  The  zero  point  on  this  ring  is  the  point  where  the  two 

* 

paths  join.  Let  e_.  be  the  Euclidean  length  of  the  ring  containing  y .  For 

★ 

j  =  l,2,...,n  we  parameterize  points  on  the  ring  containing  y ^  by  the  number  in 
[0,e_.]  going  from  smaller  to  larger  numbers  as  we  traverse  the  ring  in  a  chosen 
direction  similarly  as  in  the  previous  two  sections.  Thus  points  y.  on 

the  link  (ij,i,^)  can  and  will  be  identified  by  the  number  in  [0,e^]  specifying 

* 

their  position  on  the  ring  corresponding  to  y ^ .  It  is  easy  to  see  now  that 

* 

given  Y  r  any  collection  Y  =  {y^ ' ^2  ’  *  #  *  suc^  t^iat  Yj  li-es  in  the  interior 

of  (ij,£J  specifies  a  flow  f^  through  each  point  in  the  network  that  follows 

*  * 

the  (ordinary)  shortest  path  tree  corresponding  to  6  and  Y  and  separates  on 
each  link  in  the  two  opposite  directions  at  the  point  y^.  This  flow 

defines  a  length  function  6^  via  the  relation  S^(t)  =  d[f^(t)]  in  the  direction 
of  the  flow,  and  yields  in  the  manner  described  earlier  a  shortest  path 

tree  and  a  routing  denoted  by  g(Y).  It  is  easy  to  show  (using  the  regularity 

*  * 

of  Y  )  that  if  Y  is  sufficiently  close  to  Y  then  the  (ordinary)  shortest  path 

* 

tree  corresponding  to  is  the  same  as  the  one  corresponding  to  Y  and  that 

the  elements  of  the  routing  g(Y)  lie  on  the  links  (i  ,£,  ). 

The  algorithm  described  earlier  can  now  be  redefined  as 

(5D  -  ’(V- 

* 

The  definition  is  local  within  a  sufficientlv  small  neighborhood  of  Y  and 

* 

is  associated  with  the  (ordinary)  shortest  path  tree  corresponding  to  Y 

and  the  associated  parameterization  of  the  ring  subnetworks  containing  the 

links  (i . , i . ) . 

1  1 


Similarly  as  in  the  preceding  section  we  say  that  an  equilibrium 


Y  is  locally  stable  if  there  is  a  neighborhood  of  Y  (defined  in  terms  of 


the  parameterization  of  the  rings  associated  with  Y  as  discussed  earlier), 

such  that  the  sequence  {g(Yk>»}  generated  by  (50)  is  well  defined  and  con- 
It 

verges  to  Y  for  every  choice  of  Yq  within  this  neighborhood. 

In  order  fpr  Y  to  be  locally  stable  it  is  sufficient  that  the 

matrix  ^8^-)  be  defined  and  have  all  its  eigenvalues  within  the  unit 
dY 


nxn 


circle.  The  computation  of  )  is  straightforward  along  the  lines 


of  Section  3 

let  ~+ 


By 

We  first  introduce  some  notation.  For  j*l,2,...,n 


R  denote  the  set  of  points  t€[y,,e,]  on  the  jth  ring,  and  R 

yi,e5  3  J  yj,eJ 

denote  the  set  of  points  t€[0,yj]  on  the  same  ring.  Rote  that  for  every 

+  +  - 

j,m*  1, . . .  ,n  the  direction  of  flow  on  R  and  R  (or  R  )  must 

yj’eJ  ym,em  ym*em 

coinside  if  these  sets  have  intersection  with  positive  Lebesgue  measure. 


Hr*1 


yj’ej  Vem 


and  R 


Hr" 


yJ'eJ  ym,em 


This  implies  that  at  least  one  of  the  sets  R 

is  either  empty  or  has  Lebesgue  measure  zero.  Similarly  at  least  one  of 

the  sets  R  Hr  and  R  Hr+  is  either  empty  or  has  Lebesgue 

y.,e.  y  ,e  y.,e.  y  ,e  1 

'j*  j  m’  m  •'j’  j  ■'ra*  m 

measure  zero.  The  equations  defining  g(Y)  can  be  written  as 


P  HfF ~/v 

,1  _ 

gjCY),ej 


!  /iffwv  Mid#- 

j  ^  — z—  i •/< j 

NjOO.ej 


i  1 


By  differentiation  with  respect  to  y^  we  obtain  similarly  as  earlier  at  the 
* 

equilibrium  Y 


(51) 


ag,(Y*)  r(y*) 

— J -  . — S —  0 

dym  2d (0)  jm’ 


where 


T 
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(521 


e  =  -f  <a* [f : (y  ,tnat 

jm 


>  V*  n  R+* 


E+,  * 

3 


yj’6j 


y>e 
m  m 


•J.  ^  -  d* [f7(Y*,t)]dt 

R  *  Hr*  3 


y . ,e .  y  ,e 
}y  j  mm 


+r  d' ffT(Y  ,t)]dt 

r+*  n  r"*  3 

yj’ej  ym*em 


+f 


R~*  fi  R+* 
yj*6j  ym’em 


d1 [f*(Y*,t)]dt 


J.  ^  —  ^ 

and  fT(Y  ,t),  f ^ (Y  ,  t)  are  the  flows  on  the  jth  ring  in  the  positive  and 
negative  directions.  In  view  of  the  preceding  discussion,  at  least  two  of 
the  integrals  in  (52)  are  zero  for  every  j  and  m. 

: k 

Let  R  be  the  diagonal  matrix  having  r(y^)  as  jth  diagonal  element, 

and  let  ©  be  the  nxn  matrix  having  as  elements  the  scalars  ®.  .  Then  we  have 

jm 

m!i  .  _i_©R 

dY  2d (0)  " 


We  can  show  that  the  matrix  0  is  negative  semidef inite.  Indeed  the  matrix  -Q 
is  the  Gram  matrix  associated  with  the  functions 


XR+*  (t)  d'  [ft(Y*'r>  J 

Vej  ' 


Xr-*  <t)  d1 ( f T (Y  ,t)J  ,  j  =  1 . n. 


yre. 


where  X  is  the  characteristic  function  of  a  set  S  (X  (t)  =  1  if  tes,  X(t)  =  0 

s 

otherwise) .  By  using  the  fact  that  R  is  diagonal  it  can  be  shown  that  the  cigenvalu 

* 

X  of  ^are  real  and  nonpositive.  Consider  the  spectral  radius 

1 '  *  ’  ’ '  n  3Y 
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P  =  max  { | A  | , . . . , | A  | } 
1  n 

* 

Then  the  equilibrium  Y  is  locally  stable  for 


(53) 


P  <  1. 


and  hence  there  exists  a  threshold  level  for  d(0)  above  which  the  corresponding 
equilibrium  is  stable.  Similarly  as  in  the  preceding  section,  we  can  show 

that  if  a  fading  memory  scheme  with  decay  factor  3  is  used  to  average  the 

* 

effects  of  past  routings  the  equilibrium  Y  is  locally  stable  if 


(54) 


p 


< 


i  +  e 

l  -  6 


and  there  is  a  value  of  B  which  optimizes  the  rate  of  convergence.  It  is 

also  possible  to  show  that  the  other  forms  of  averaging  the  effects  of 

several  past  routings  improve  the  stability  properties  of  the  algorithm. 

For  the  purpose  of  aiding  the  reader  in  understanding  the  method  of 

9q(Y*) 

calculation  of  the  matrix  —  we  provide  an  example. 


Example :  Consider  the  network  shown  in  Figure  8  where  node  4  is  the 

destination,  and  assume  that  the  regular  routing  ly^,  y2»  y ^ '  shown  in 

an  equilibrium.  The  figure  shows  also  the  chosen  positive  direction  on 

★ 

the  ring  corresponding  to  each  y.  . 


I 

\ 
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4 

Figure  8 


We 

The  interval 
between  some 


calculate  the  symmetric  matrix  ©  with  elements  6 
between  any  two  nodes  i  and  X  is  denoted  [i,X], 
y^  and  a  node  X  is  denoted  [y^.X].  We  have 


'11 


22 


33 


J  d* [ f * (Y  > t) J  dt 

[y*,l]  U[l,3]  U[3,4] 

J"  *  d’  f  £~  (Y* ,tr)  J  dt 

[y2>2]  U [2,3] 

J  d’ [ fj (Y* , t) ]  dt 

[ y 3 » 2 ]  U [2,3]  U [3,4] 


-J'*  d '  [  f  ~  ( Y* 

[y^l  1 


-J  *  d 

t y2 , i J  u [i,3] 


-J'*  d’lf3(Y 


[y3,^l 


e12  *  -  j’  d’  [f|<v  ,t> )  at 

[1.3] 

e23  -  -  j'  d-  ir*(Y*,t))dt 

[2.3] 


given  by  (52) . 

JIU 

The  interval 

,t)J  dt 

'[f“(V*,t)]  dt 

,t))  dt 


- 1 


d' [ f ^ ( Y*  » t) ]  dt 
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Abstract 

this  paper  provides  analysis  and  computa t lonal 
results  relating  to  the  dyr.amc  behavior  of  shortest 
path  routing  algorithms  for  store  and  forward  common i~ 
cation  networks.  A  companion  paper  (1)  focuses  on 
networks  with  a  single  destination.  The  present  work 
considers  networks  with  multiple  destinations. 


X .  Introduction 

This  paper  is  a  sequel  to  a  companion  paper  II j 
which  examines  the  dynamic  behavior  of  shortest  path 
routing  algorithms  for  communication  networks  with  a 
single  destination.  We  examine  here  the  case  where 
there  are  several  destinations.  Generally  speaking, 
the  results  obtained  for  single  destination  networks 
have  extensions  to  the  multiple  destination  case 
although  the  analysis  is  considerably  more  complex. 
Similarly  a3  for  single  destination  algorithms  va 
find  that  the  addition  of  a  Mas  factor  and  the 
presence  of  an  averaging  mechanism  have  a  stabilizing 
effect  on  dynamic  behavior.  Our  results  also  suggest 
that  the  presence  of  multiple  destinations  has  a 
damping  effect  on  the  dynamic  behavior  of  the 
algorithm.  Similarly  as  in  (1)  we  consider  a  network 
model  with  a  continuum  of  nodes  and  rely  on  methods 
of  convergence  analysis  for  discrete-time  systems 
with  Euclidean  state  space.  The  possibilities  for 
extension  of  these  results  to  finite  node  networks 
seem  limited.  However,  it  appears  that  conclusion*; 
on  algorithmic  behavior  drawn  from  analysis  of  the 
continuous  model  remain  at  least  qualitatively  valid 
for  finite  node  networks.  The  conjecture  is  supported 
by  results  of  computational  experiments  provided  in 
Section  3.  Throughout  the  paper  we  assume  that  the 
leader  Is  familiar  wlrh  (1). 


2.  A  Continuous  Model  of  a  Ring  Network  with 

Multiple  Destinations 

We  consider  a  continuum  of  nodes  arranged  in  a 
ring  and  sending  traffic  to  N  points  on  the  ring 
referred  to  as  the  destinations .  A  point  is  selected 
on  the  ring  and  is  referred  to  as  the  origin.  Every 
other  point  on  the  ring  is  identified  with  its 
Euclidean  distance  t  from  the  origin  in  the  counter¬ 
clockwise  direction,  where  t  is  normalize J  to  take 
values  in  the  interval  (0,1J.  The  destin.it ions  are 
identified  with  their  distance',  from 

the  origin.  We  assume  that 


Given  any  two  distinct  points  t^,  t^ 
interval  R*  .  between  t  and  t  in 

V  2  1  2 

clockwise  direction  is  defined  to  bo 


on  the 
the  co 
the  r,  e  t 


ring,  th«* 
unter- 


'Vj1 


if  Vt? 


<u 


[tj.lt  U  IO.t2 1  if  2 


5. .-.4  lari y  the  interval  P  between  t  and  t  in  th* 

r  a  1  * 

clockwise  direction  is  defined  to  be  the  set 


t,.t. 


[Q.tjJ  0  [t2.l|  if  tj<t2 


u> 


•w 


If  Vt2 


f  or  t  •  t  we  deftn.  P  -  R  •  (t.  }-{t ,) 

1'  2  0  2 

ttotice  that  we  have  for  ell  6(0,1) 


V*i 


For  cash  i  -  l,...,ri  we  are  given  a  continuous  function 
ri‘  l0,1’  *  ‘»uch  that  r^(0)  "  r^U).  We  refer  to 

r  , i»l . . . . ,N ,  as  the  ;  density  function  for 
destination  i.  The  meaning  of  r ^  is  that  for  any  two 

distinct  points  c,,t.  on  the  ring  the  total  traffic 
12  ♦  ■ 

input  that  originates  in  R  (R  )  and  destined 

1'  2  V  3 


for  x  is 


x  f  t )  dt  (./fi 


R  x(t)dr). 

v  *:  I'  2 

We  rev  ir’troduc«»  n  »tiocji  of  length  end  distance 
along  the  ring.  These  notions*  will  be  considered  in 
both  t  e  clockwise  and  counter? lookvise  directions 
which  are  also  the  negative  and  positive  directions  on 
function  we  mean  a  function  which 


(0.1).  By  a  lejvj _ 

assigns  to  each  ;>oint  teiQ#l)  two  positive  numbers  6*  (t) 


and  6  (t),  th*  first  associated  with  the  positive 
direction  and  the  second  associated  with  the  negative 
directi'. n.  Thus  a  length  function  can  be  identified 

with  the  corresponding  pair  (6*, 6  )  . 


In  what  follows  attention  will  be  restricted  to 
lemth  functions  A  •  (6*,6~)  for  which  6*  and  6~  are 
piecewise  centin.j,ti3  on  {0,1).  Given  such  a  length 
function  vo  the  distance  A/*ltj  of  any  two 

points  -j.t  ••:<•,]).  tj  f  tv  in  the  positive  direction 
1/ 


A 

r 


jdt. 


<j) 


Mr.larlv  th«  ir.ee  A.-(t,.t,J  of  t  and  t  In  the 

oil  *  « 

r.eptive  direction  Is  defined  by 


(t)d 


(4) 


l  ?7 

CilU8f--0/.*'i/:i00n-0l '■  '  H" 


Given  *  length  function  (6*,  5  ) ,  it  is  clear  that 
there  exists  for  every  l  a  point  z^efO,!]  such  that 
*4  y  x.  and 

A6-(*i#xi)  -  Afi>(zi#xi).  (5) 

The  point  z ^  is  unique  except  in  the  singular  case 
where  •  0  and  •  1  both  satisfy  (5).  Define 


Note  that  is  the  counterclockwise  Euclidean 
distance  between  and  x^  along  the  ring.  Clearly  w« 
have  0<y^<l  for  all  i.  The  vector  Y  *  <y^#...,y ) 

defined  by  (5)  and  (6)  is  referred  to  as  the  shortest 
path  routing  generated  by  (6*,  6~) .  It  is  easy  to 
verify  that  Y  has  the  property 

xi  T  yi  4  x2  ♦  y2  <  •••  *  xN  ♦  • 

More  generally  by  a  routing  we  mean  an  element 

of  10,1]N  (the  Cartesian  product  of  N  copies  of  (0,11). 
Given  a  routing  Y  -  )  consider  for  each  1 

for  which  y^  ?  1  the  point  x^  on  the  ring  given  by 


destination 
and  f  (*,t) 
car.  b«  secs 


points  x  ,...#x  .  for  every  fixed  t,f*(«,t) 
**  ^ 

.re  continuous  on  (0,1)  .  Furthermore  it 
thit  lor  .11  i  ind  teiO,!)1* 


3t  (Y.t) 


3*i 


-< 


-r  <*  )  if  t€R 

i  1  z  ,x  > 

i  1 


il  t fTH 


tf*  x 


(12) 


ii~ (Y.t) 


it  xjfk 


fr  (*  )  if  teir  *  *  « 

l  i  VV 


Ill) 


where  z  ^  is  defined  in  terns  of  y^  via  (7). 

Similarly  as  in  (1),  we  are  given  a  continuously 
differentiable,  monotonically  increasing  scalar 
function  d  of  flow  such  that  d(f)>0  for  all  f >0. 

(For  simplicity  we  exclude  the  possibility  d(0)  *  0. 

It  was  shown  in  (1)  that  unstable  algorithmic  behavior 
results  in  the  single  destination  case  If  d(0)  »  0)  . 
Given  a  routing  y  we  define  the  length  function 

(6y,  dy>  corresponding  to  Y  by 


(xi  ♦  h  - 1  lf  xi  ♦  >  1 


C7| 


Define  for  each  i  -  and  te(0,l)  the  flow 

f^(Y,t)  at  t  In  the  positive  direction  for  destination 

i  by 


f*(Y.t) 


if  fj-1,  or  y^l 
and  teR* 

l'Xi 

lf  y.*l  and  teR* 

i'  1 


«*(t)  -d[f*(y.t)l,  vte(o.l) 

U«) 

«'(t>  -  dlf~(t.t)l.  «*[0.1]  . 

U5) 

v»  denote  by  g(Y)  -  tg^ (Y) , . ,g^(Y) )  the 

■hortmnt 

path  routing  generated  by  (6y,6^V^We,are 

lntamtad  In 

the  algorithm 

\*X  *  9,V 

(16) 

where  Y  is  a  given  initial  routing, 
o 

• 

We  say  that  Y  is  an  equilibrium  routing  If 

Similarly  define  the  flow  f^(Y,t)  at  t  in  the  negative 
direction  for  destination  1  by 

If  y.  *1  and  teR 

i  Vxi 

r.  <T)dx  if  y>l  and  tes”  _ 

1  1  Vxi 


t  ^ (T)dx  if  Yl  -  1.  (9) 

Oatina  also  tha  total  flows  In  the  positiva  and  naqa- 
tlva  dlraction  at  te(0,l)  by 
♦  »  * 

f  (Y.t)  -  I  fT(y,t)  uo) 

i-i  1 


•  • 

Y  *  g(Y  )  . 

Since  g(Y)  belongs  to  (0,1) W  for  every  routing  Y, 
it  follows  that  an  equilibrium  Y*  must  belong  to 

(0,1)  .he  have  the  following  proposition  regarding 
existence,  uniqueness,  and  optimality  of  an 
equilibrium.  The  proof  is  quite  lengthy  and  has  been 
releg *ted  to  Appendix  A. 


Proposition  I:  There  exists  a  unique  equilibria 
routing  t*.  Furthermore  Y#  miniadzes  over  all 

X 

Ye (0,1)  tha  expression 


J(Y) 


ptf  (Y, t) Jdt 


ptf  (Y.t))dt 


where  p  is  any  function  satisfying  for  all  f 


w 

t  <Y,t)  •  £  r  (v,t)  Ui) 

i-i  4 

Notice  that  for  flxsd  *  -  (y  , ...,y  )  the  functions 
♦  -  1  w 

f  (Y,*)  and  f  <Y,*J  can  be  discont inuous  only  at  the 


w«  have  assumed  earlier  that  d<0) >0.  If  this 
assumption  is  replaced  by  d(0)>0  then  Proposition  1 
can  still  be  shown  to  hold  except  for  the  uniqueness 
part.  Existence  of  an  equilibrium  can  be  shown  by 
uBing  raxutam’s  fixed  point  theorem  ((21,  p.  *7)  in 
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place  of  Brower'*  theorem  In  the  proof  of  Appei. 7  . 
The  proof  of  the  optimality  property  of  an  squill!  riua 
given  in  Appendix  A  is  also  valid  under  the  assurption 
d(0)  >  0. 

We  now  evaluate  the  Jacobian  matrix 


Tor  any  routing  Y€<0,1)  define  g.(Y),  i-l,...,N,  by 
the  equation  (cf.  (7)J.  1 


Then  w*  can  write  the  Jacobian  (17)  evaluated  at  Y  ad 


-  MS.  (22) 

We  now  establish  that  the  catrix  6  is  negative  seal* 


definite .  Pot  any  set  S  denoted  by  X^.  the  char ac terra- 

tic  function  or  S,  i.e.  X  (t)  -  1  if  tes,  end  *  (t)-0 
.  s  s 

if  t£$.  It  c*n  be  seen  that  *6  is  the  sum  of  two 
positive  se^ideiinite  matrices.  The  first  matrix  Is 
the  Crap  oat  rut  of  the  functions 

v  .  .  ?d(f(yVtn 


in  L2 10,11  (13),  p.  56),  and  the  second  matrix  is  the 
Gram  matrix  of  the  functions 


3dIt*(Y*,t)| 


*1-K»i(V)  if  *1+gi(V)<l 


Xi+qi(Y)-l  if  xi+gi(Y)>l 


The  equation  defining  gi (Y)  is  Icf.  (3)  -  (5),  (14), 


Uf~(Y,t))dt  -  d(f+(Y,t)ldt.  tlva 


qi(Y).xi 


Differentiation  of  this  equation  with  respect  to 
yields  similarly  as  in  ( 1 J  the  following  formula 

VV[/  ..  iiujpjil  J 

- ‘y*i  "*■■<»•  ■. _ 


where  z ,  and  x ^  are  given  by  (7).  At  an  equil i-biruo 

•  • 

Y  -  we  have 


Since  every  Gram  aiatxix  Is  positive  semide finite  It 
follows  that  9  la  negative  senidef inite.  Now  the 

eigenvalues  of  *  DOR  are  the  same  as  the 

eigenvalues  of  the  matrix  which  la 

a  negative  senidef  inite  matrix.  It  follows  that  all 

eigenvalues  of  - *  are  real  end  nonpo*i~ 

tlve.  it  is  also  possible  to  show  that  =  haa  & 


•et  of  eigenvectors  that  form  a  basis  for  fP,  i.e.  it 
is  diagonal! zable,  Let  p  bt  the  spectral  radius  of 

3g<y*>  ,  0 

3  Y  * 

1 

u  -  •  U3> 

• 

Similarly  as  In  (1),  we  say  that  an  equilibria*  Y 
is  locally  stable  if  there  exists  ~e-  neighborhood  H  of 
Y*  such  that  If  y  €W  then  the  sequence  (y.  }  generated 

O  .  k  * 

by  the  algorithm  (16)  remains  In  N  and  converges  to  Y  . 

Using  Ostrovski’s  theorem  (12],  p.  300*301)  and  the 
-  -  ( v  * )  * 

fact  that  :-a~— — —  has  reel  eigenvalues  and  is  dl  agonal - 


i  z&ble  ve  can  prove  the  following  proposition: 

♦  •  e 

propositlca  2:  Am  equilibrium  Y  “  (y^ ,y^)  Is 
locally  stable  if 


where  u  is  defined  by  (23).  Furthermore  if  (Y^)  •*  Y 
and  Y  ^  Y*  for  all  k  there  exists  a  norm  ||*||  on  R 


where  for  all  i 


if  x/Y.il 


^  Xi^yi  1  if  *1*^1  1 

let  h  *rd  l>  De  the  ritri'**'5  having  r  (t  )  a-.  1 

,  -  *  •  1 

(d  [  f  (Y  ,1^)1  ♦  d(f  (Y  .z^))}  respectively  a-i  ith 

diajo'isl  elements.  Let  also  0  be  the  symmetric  H  *  N 
matrix  having  elements 

r  -  .  .  .  ] 

,  ..lr  ttlLjUUU,.’  . 

11  1  '•/  ,  J 

v  »  «  *r  I  r  I  I  i  <  ;i  > 


l  to  sup  - - 

)r~  I  K 


as  in  (1),  let  us  write 


where  z  -  d (0)  represents  bis: .  It  follows  from  the 
prec**  i : ' :  analysis  that  a  sufficiently  high  level  of 
bus  vi.i  :o  u it  a  locally  stable  equilibrium  end  an 
arju-ve  :  *„r.ilat  to  the  one  of  (1]  show*  that  for 
suf f i: *r-  t’y  high  level  of  bias  the  algorithm  will  con- 
veri-  t*  an  eT^illbriiss  for  every  initial  routing  tc- 


When  there  is  a  single  destination  (N»l)  we  have 

_  *  *  4.  *  • 

t  (Y  ,z^)  »  MY  m  0  and  the  denominator  in  (19) 

equals  2a.  When  there  are  more  than  one  destinations 
we  will  usually  have  f  (y  ,z^)  jt  0  and  f+(Y  ,z^)  j4  0 

and  the  denominator  in  (19)  can  be  significantly 
larger  than  2a  .  Thus  it  is  possible  to  have  a  stable 
equilibrium  even  if  a  is  very  small  while  this  is  not 
possible  when  there  is  a  single  destination.  Based  on 
this  fact  one  is  tempted  to  conclude  that  the  presence 
of  more  than  one  destination  tends  to  have  a  benefi¬ 
cial  effect  on  the  dynamic  behavior  of  the  algorithm. 
This  conjecture  is  supported  by  the  results  of  compu¬ 
tational  experiments,  but  we  have  been  unable  to 
formulate  it  and  establish  it  mathematically. 

As  in  (11,  it  is  possible  to  define  and  analyze 
an  algorithm  where  the  bias  a  depends  on  the  current 
routing  Y^.  Similar  results  as  those  of  (1J  can  be 

obtained,  so  we  ocsait  the  details. 

Basing  the  Routing  Decision  on  More  them  one  Past 
Routings 

It  was  seen  in  (1]  that  the  dynamic  behavior  of 
the  algorithm  for  the  single  destination  case  can  be 
improved  by  employing  some  form  of  averaging  of  the 
effects  of  several  past  routings.  This  analysis  and 
the  corresponding  conclusions  can  be  generalized  to 
the  multiple  destination  case. 

As  an  example  consider  the  case  where  the  length 
function  (6“,  6*)  used  in  generating  Yfc+1  depends  on 

all  previous  routings  Y^,  Yfc_1,...,via  a  fading 
memory  scheme  of  the  form 

6k(t>  "  66k-i(t)  *  vte[o,lj 


3q.(Y*) 

9Y 

the  linearized  system  is  stable  if 


It  follows  from  the  fact  X^O  and  (23)  that 


V  < 


1  ♦  B 
1-0 


By  cosparing  this  ineq  :ality  with  (24)  we  see  that  the 
fading  memory  scheme  improves  significantly  the 
convergence  properties  of  the  algorithm.  The  value  of 
0  for  which  an  optimal  rate  of  convergence  is  obtained 
is  the  one  that  minimizes  max  {|0  +  (1-0) |>  . 


Similarly  one  can  obtain  extensions  of  other  results 
obtained  in  [1J  Jn  connection  with  averaging 
algorithms  for  the  single  destination  case. 

3.  Computational  Results 

We  experimented  with  a  30-node  ring  network  and 
considered  a  synchronous  and  an  asynchronous  algorithm 
with  evenly  spaced  delay  broadcasts.  A  fading  meaary 
scheme  was  used  to  average  delays  corresponding  to 
the  present  and  past  routings.  In  this  scheme  "delays" 
are  computed  at  each  iteration  by  means  of  tha  formula 


(New  Delay  of  Link  (1,1)1  - 

•0 [Old  Delay  of  Link  (i,£)J  + 

♦  (1-0)  (0.05) ^(Current  flow  of  (i,£)]* 

(25) 

The  scalar  0  is  referred  to  as  the  decay  factor  and 
takes  values  in  the  interval  (0,1).  Large  values  of 
8  imply  a  greater  degree  of  averaging  with  delays 
corresponding  to  past  routings.  The  length  of  link 
(i,i)  used  in  the  shortest  path  computation  was  taken 
to  be  * 


4*(t)  -  +  <l-B)d[f+<Yk,t)l,  vte[0,l) 

where  $e(Q,l)  is  the  decay  factor.  Then  the  linearized 
system  corresponding  to  an  equilibrium  Y*  is  given 
by  (cf.lUJ 


[Length  of  Link  (1,1))  -  Bias  a  (New  Delay  Link  (1,1)1 

The  bias  depends  on  the  current  routing  (c.f.  (11) 
and  was  taken  to  be  'v*^ 

Bias  “  0.02  x  (Sum  of  most  recently  "reported  delays” 
over  ell  links). 


Vi  ‘V8Yk-i+8V2+---J  • 


Write 


Vi  *  *j.  ♦  BY_  ♦  ... 

Then  we  have  for  all  k 

Vi  -  <l-8>la5fL  V8(1-8,5f7L1*k 


if  all  eigenvalues  of  the 

bu-B)  ^aiJLL 
L  1  Bi 

where  I  is  the  NxN  identity  matrix,  lie  within  the 
unit  circle.  Since  this  matrix  has  rank  N  it  has  N 
eigenvalues  equal  to  zero.  Its  remaining  N  eigen¬ 
values  can  be  shown  to  equal  the  eigenvalues  of  the 
«w»tru«  BI  ♦  (1-8)  23ilIL  which  *r«  BMl-8)^, 

1  -  1 , . . . ,N  where  \ is  the  ith  eigenvalue  of 


ktl 


■  \  ♦  Bv 


This  system  is  stable 
matrix 


(i  -6) 


2g(Y  ) 
Ay 


In  the  synchronous  algorithm  \ll  nodes  "report" 
their  link  delays  simultaneously  at  each  iteration 
and  all  of  these  delays  are  used  in  the  shortest  path 
computation  that  determines  the  new  routing. 

In  the  asynchronous  algorithm  nodes  compute  their 
delays  at  every  iteration  by  using  equation  (25). 
However  they  "report"  their  link  delays  only  every 
30th  iteration,  with  node  1  reporting  at  tha  1st 
iteration,  node  2  at  the  2nd  iteration  and  so  on.  Thus 
for  example  at  the  31st  iteration  node  1  will  report 
his  link  delays  and  the  new  routing  will  be  computed 
on  the  basis  of  the  delays  reported  by  node  2  at  the 
2nd  iteration,  by  node  3  at  the  third  iteration,  and 
so  on.  This  procedure  is  patterned  after  the  asyn¬ 
chronous  operation  of  the  algorithm  in  the  ARPANET. 

The  traffic  inputs  for  destination  30  are  given  at 
the  bo t too  of  tables  1-3.  The  traffic  sent  by  every 

node  to  each  of  the  other  destinations  1,2 . 29  ms 

taken  to  be  the  same  and  equal  to  X.  We  consider  two 
values  a  •  0.05  and  X  -  1.  in  all  runs  the  Initial 
routing  for  destination  i  was  taken  to  be  (1  ♦  15) 
(r-odulo  30) .  We  show  in  tables  I  -  3  the  generated 
sequences  of  successive  routings  for  destination  30, 
(i.e.  the  sequences  of  the  numerically  largast  node 
rojtir.?  ressages  to  destination  30  in  the  clockwise 
direction).  The  sequences  of  routings  for  the  other 
destinations  are  not  shown.  They  exhibited  very 
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similar  behavior.  An  entry  a/b  for  the  aayn.  -ronous 
algorithm  means  that  during  a  30-iteration  cycle  the 
minimum  and  maximum  routirgs  are  a  and  b.  The  results 
indicate  that  all  the  conclusions  reached  regarding 
the  effects  of  bias  and  averaging  are  valid  for  finite 


node  netvorka.  Furthermore,  as  the  level  of  X  of  traffic 
input  to  the  destinations  1  through  29  is  increased, and 
the  contribution  of  all  destinations  to  the  total  traf¬ 
fic  is  more  nearly  equal,  the  dynamic  behavior  of  the 
algorithms  is  improved. 
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Appendix  A:  Proof  of  Proposition  1 

The  function  g:  (0,1]N  *►  (0,1]N  is  clearly  continuous 
so  by  Brower's  fixed  theorem  ([2],  p.  161)  it  has  a 
fixed  point  Y*  which  is  an  equilibrium. 

* 

In  order  to  show  that  Y  is  unique  and  minimizes 
over  «ll  Ye(0,I]N 

J<Y)  p(f+(Y,t))dt  +^1ptf”(Y,t)]dt  (A.l) 

we  consider  an  associated  convex  programing  problem. 

Let  L^ (0, 1]  be  the  space  of  (equivalent  classes  of) 
square  lntegrable  function  on  (0,1]  with  norm 

"'ll"  lfo  • 

The  Cartesian  product  l”  of  n  copies  of  L^IOpl),  where 
n  is  any  positive  integer,  will  have  the  norm 

Htfj . fn>||  -  tlj  [*i(t)l2dt)1/2  . 

With  this  norm  Lj  (0, 1]  Is  a  Hi.lb.rt  apse,  with  lnn.r 
product 

nfl 

<(fj, . <V'<,i"”'9n*>  ■  I  Jo  f1(t)gi(t)dt, 

for  .11  (f. . f  )e  l"(0,1),<9, . .  )CL™I0,U  .  Any 

i  n  «  x  n  * 

•lament  (g,.....9  )eij(0,l)  defln.s  •  bounded  linear 
l  n  * 

functional  on  (•"(0,11  by  ream  of  the  preceding  equa¬ 

tion,  and  all  bounded  linear  functionals  on  LjtO.ll 
can  be  defined  this  way. 


minimize  p(f+(t))dt  *f  ptf  (t))dt 

K  f  ♦  ♦ 

subject  to  t  J +  riiT)ui(T)dT  -  f  (t>  -  0 

1-1  J  *i<t 

a. a.  te[0,l), 

I  JR-  r^(t)u^  (T)dr  -  f  (t)  •  0, 

1^1  Xj .t 

a. a.  tcl0.ll  , 

0£u*(t).  0<u^  (t) ,  u*lt)  ♦  u^(t)-l, 

a. a.  te[0,l), 

f*.  r.  u*.  o’  eVOvil.  l-l . wa  2) 

where  a.a.te[0,l]  means  for  almost  all  tetO.l]  with 
respect  to  Lebesgua  measure. 

To  each  routing  Y  “  (y^  ,  . .  -  .yN>  with  correspond¬ 
ing  vector  2  -  (Zj,...,zH)  defined  by  (7)  we  can 

associate  the  following  feasible  solution  of  problem 
(A.2) 

f+(t>  -  f*(Y,t).  f"(t)  -  f*(Y.t)  (A.J) 


u.it) 


u4(t) 


0 

if 

1 

If 

xi 

0 

If 

tAvT 

1 

if 

teR 

i'i 


i'  1 


1'  1 


(A. 4) 


Th.  corresponding  value  of  the  objective  or  prohlea 
(A.2)  is  J(ij .  The  feet  that  an  equilibria  routing 
minimizes  J(Y)  follows  from  the  following  lemi 


Lenena  A.l:  If  y  Is  an  equilibrium  routing  than  the 

functions  f*\  f*‘,  u**,  1  -  1 . n  correspond- 

ing  to  Y  via  equations  (A.3)  and  (A. 4)  are  an  optimal 
solution  of  problea  (A.2). 


Proof i  Consider  the  functions  d[f* «*.•)), 

»  » 

d(f  (Y  ,  •) l€Lj(0,lJ .  By  the  sufficiency  theorem  of 

(3),  p.  220  the  result  will  follow  If  we  show  that 
*+  •-  »+  *_ 

*  *  t  #  ui  '  ui  we  w  optimal  solution  to  the 

problem 


We  consider  the  following  convex  programming 
problem  in  L^^fOpl)  which  falls  within  the  frame¬ 
work  given  in  Luenberger  ((3),  Chapter  8) 
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minimize 


<t)|  ♦  pie  <t>) 


■/0>'+< 

♦  .  M  f  *  + 

♦  dtf  <y  ,t)ll  I  Jg+  ^tij^CDdr  -f  (t)l 


1-1  xi,t 


♦  dlf'<Y*,tm  I  L *  r.  (T)u"(T)dT-f"(t)]\d 

i-1  Rxi<t  ’ 

subject  to  0<u*(t),  <Ku”(t) ,  u*(t)  +  u~(t)  -  1# 

a.a.te[0,l),  1-1 . M  . 


(A.5) 


Define 


D*  (t)  -  /,♦  dlf*(Y*,t)ldt 

1  t.x1 

/-  d(f'(Y*.T)1dt  . 


D.  (t)  - 
1 


A  straightforward  calculation  using  Integration  by 
parts  shows  that  problem  (A.S)  can  be  written  as 


minimise 


iV 


<t)l  ♦  Plf  (til 


-  dIf*<Y*,t)]fV)  -  d[f"(Y*.t)lf"(t) 


that  (A .1)  holds  lor  all  tetO.ll.  This 
the  assumption  d(0>  >0  implies  that  y 


^togs 
,  -  Y 


♦  I  ID*  (t)r.  <t)u?(t)+D~  (t)r.  (tJuT(t)lfdt  | 

1-11  "i  1  1  ’ 

subject  to  0<u*(t),  Ofu~(t),  u*(t)  ♦  u^it)  -  1, 

a.a.tetO.l],  i-l,...,N 

Osina  the  fact  that  »  d.  It  Is  easv  to  see  that 

•+  •-  •_  9“ 

t  .1  ,  ,  u^  ,  i  -  l....,N  are  an  optimal 

solution  to  this  problem.  Q.E.D.  ’ 

It  remains  to  show  uniqueness  of  the  equilibrium. 

Since  d(f>  >  0  for  all  t,  all  d  is  monotonically 
increasing ."the  function  p  is  strictly  convex.  Let  r 
be  the  convex  set  of  alKf^.f'lebjl0'^!  f°r  which 

there  exist  t* ,  f”,  u^.  u^  1  -  1,...,N  which  are 

feasible  for  problem  (A. 2).  Problem  (A. 2)  can  be 
written  as 

minimise/1  {plf*  (t)|  ♦  ptf"(t)J}dt  (A.6) 

J0 

subject  to  (f*,f~)er. 

a  • 

If  and  Ya  ara  two  aquilibria,  than 

lf*lY*.-l,  f‘(Y*,*)l  andtf*(Y*,«)  ,  f*(Y*,-JI 

are  both  optimal  solutions  of  problem  (A.6).  Using  the 
strict  convexity  of  p>  it  follows  that  except  for  t 
in  a  set  having  Lebesgue  measure  sero 

f*<Y*,t)  -  t*(Y’,t),  f~(Y*,t>  -  f‘(Y*,t). 

♦  .  a .  <*•’> 

Since  f  (Yj,*>,  f  (Yj.M,  f  (Y^-J,  f  lYj.M  are 
continuous  everywhere  except  at  x^» .. . .x^,  it  follows 


ttber  with 
*.  Q.E.D. 


in 


